Jul 05 17:11:30 devstack cinder-volume[75194]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 17:11:30 devstack cinder-volume[75194]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 17:11:30 devstack cinder-volume[75194]: we strongly recommend against using it for new projects. Jul 05 17:11:30 devstack cinder-volume[75194]: If you are already using Eventlet, we recommend migrating to a different Jul 05 17:11:30 devstack cinder-volume[75194]: framework. For more detail see Jul 05 17:11:30 devstack cinder-volume[75194]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 17:11:30 devstack cinder-volume[75194]: import eventlet # noqa Jul 05 17:11:32 devstack cinder-volume[75194]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 17:11:32 devstack cinder-volume[75194]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 17:11:32 devstack cinder-volume[75194]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 17:11:33 devstack cinder-volume[75194]: INFO dbcounter [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Registered counter for database cinder Jul 05 17:11:33 devstack cinder-volume[75194]: DEBUG oslo_db.sqlalchemy.engines [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:11:34 devstack cinder-volume[75194]: DEBUG dbcounter [-] [75194] Writer thread running {{(pid=75194) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 17:11:34 devstack cinder-volume[75194]: INFO cinder.rpc [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 17:11:34 devstack cinder-volume[75194]: INFO cinder.rpc [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 17:11:34 devstack cinder-volume[75194]: DEBUG oslo_db.sqlalchemy.engines [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:11:34 devstack cinder-volume[75194]: INFO cinder.volume.manager [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Determined volume DB was empty at startup. Jul 05 17:11:34 devstack cinder-volume[75194]: DEBUG cinder.volume.manager [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75194) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 17:11:34 devstack cinder-volume[75194]: INFO cinder.volume.manager [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 17:11:34 devstack cinder-volume[75194]: WARNING stevedore.named [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 17:11:34 devstack cinder-volume[75194]: WARNING castellan.key_manager [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 17:11:34 devstack cinder-volume[75194]: WARNING cinder.keymgr.conf_key_mgr [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 17:11:34 devstack cinder-volume[75194]: DEBUG cinder.volume.drivers.lvm [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75194) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 05 17:11:34 devstack cinder-volume[75194]: DEBUG oslo_concurrency.processutils [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:34 devstack cinder-volume[75194]: DEBUG oslo_concurrency.processutils [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.490s {{(pid=75194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_db.sqlalchemy.engines [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:11:35 devstack cinder-volume[75194]: INFO cinder.rpc [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 05 17:11:35 devstack cinder-volume[75194]: INFO cinder.rpc [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 05 17:11:35 devstack cinder-volume[75194]: WARNING stevedore.named [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 17:11:35 devstack cinder-volume[75194]: WARNING castellan.key_manager [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 17:11:35 devstack cinder-volume[75194]: INFO cinder.volume.manager [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_db.sqlalchemy.engines [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:11:35 devstack cinder-volume[75194]: INFO oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Starting 1 workers Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Started child 75390 {{(pid=75194) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Full set of CONF: {{(pid=75194) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] ******************************************************************************** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Configuration options gathered from: {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] ================================================================================ {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] allow_availability_zone_fallback = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] allow_compression_on_image_upload = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] allowed_direct_url_schemes = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] api_rate_limit = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] auth_strategy = keystone {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] az_cache_duration = 3600 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_availability_zone = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_host = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_stats_polling_interval = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backup_api_class = cinder.backup.api.API {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backup_name_template = backup-%s {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backup_use_same_host = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backup_use_temp_snapshot = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] chap_password = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] chap_username = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_internal_tenant_project_id = 3b520bc756394f5aba60524d1daf8878 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_internal_tenant_user_id = 207776b17d34446fb1b266b8a85b2415 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cloned_volume_same_az = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cluster = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75390]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] compression_format = gzip {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] compute_api_class = cinder.compute.nova.API {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] config_dir = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] config_source = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] control_exchange = openstack {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] debug = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] default_availability_zone = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] default_group_type = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] default_volume_type = lvmdriver-1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] disk_geometry = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] driver_client_cert = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] driver_client_cert_key = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] driver_data_namespace = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] driver_ssl_cert_path = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] driver_ssl_cert_verify = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] driver_use_ssl = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] enable_force_upload = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] enable_new_services = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] enable_unsupported_driver = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] enforce_multipath_for_image_xfer = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] filter_function = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_api_insecure = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_api_ssl_compression = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_ca_certificates_file = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_catalog_info = image:glance:publicURL {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_certfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_keyfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_num_retries = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance_request_timeout = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] goodness_function = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] graceful_shutdown_timeout = 5 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] group_api_class = cinder.group.api.API {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] host = devstack {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_compress_on_upload = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_conversion_address_space_limit = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_conversion_cpu_limit = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_conversion_disable = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_upload_use_cinder_backend = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_upload_use_internal_tenant = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_volume_cache_enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_volume_cache_max_count = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] image_volume_cache_max_size_gb = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] init_host_max_objects_retrieval = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] instance_format = [instance: %(uuid)s] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] iscsi_target_flags = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] iscsi_write_cache = on {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] iser_helper = tgtadm {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] iser_ip_address = 192.168.122.181 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] iser_port = 3260 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_color = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_config_append = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_dir = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_file = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_options = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_rotate_interval = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_rotate_interval_type = days {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] log_rotation_type = none {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] max_age = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] max_logfile_count = 30 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] max_logfile_size_mb = 200 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] max_over_subscription_ratio = 20.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] message_reap_interval = 86400 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] message_ttl = 2592000 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] migration_create_volume_timeout_secs = 300 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] monkey_patch = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] monkey_patch_modules = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] my_ip = 192.168.122.181 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] no_snapshot_gb_quota = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] num_iser_scan_tries = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] num_shell_tries = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] num_volume_device_scan_tries = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] nvmeof_conn_info_version = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] nvmet_ns_id = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] nvmet_port_id = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] osapi_max_limit = 1000 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] osapi_volume_ext_list = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] osapi_volume_listen_port = 8776 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] osapi_volume_use_ssl = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] osapi_volume_workers = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] per_volume_size_limit = -1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] periodic_fuzzy_delay = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] periodic_interval = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] public_endpoint = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] publish_errors = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] quota_backup_gigabytes = 1000 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] quota_backups = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] quota_gigabytes = 1000 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] quota_groups = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] quota_snapshots = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] quota_volumes = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] rate_limit_burst = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] rate_limit_except_level = CRITICAL {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] rate_limit_interval = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] reinit_driver_count = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] replication_device = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] report_discard_supported = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] report_interval = 120 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] reservation_clean_interval = 86400 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] reservation_expire = 86400 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] reserved_image_namespaces = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] reserved_percentage = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] rpc_response_timeout = 120 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] run_external_periodic_tasks = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] scst_target_driver = iscsi {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] scst_target_iqn_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_down_time = 720 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] shell_completion = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] snapshot_name_template = snapshot-%s {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] snapshot_same_host = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] split_loggers = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] state_path = /opt/stack/data/cinder {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] storage_availability_zone = nova {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] storage_protocol = iSCSI {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] syslog_log_facility = LOG_USER {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] target_helper = lioadm {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] target_ip_address = 192.168.122.181 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] target_port = 3260 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] target_protocol = iscsi {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] target_secondary_ip_addresses = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] trace_flags = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] transport_url = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] until_refresh = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] use_chap_auth = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] use_default_quota_class = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] use_journal = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] use_json = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] use_multipath_for_image_xfer = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] use_stderr = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] use_syslog = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] verify_glance_signatures = enabled {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_api_class = cinder.volume.api.API {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_backend_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_clear = zero {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_clear_ionice = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_clear_size = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_copy_bps_limit = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_dd_blocksize = 1M {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_name_template = volume-%s {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_service_inithost_offload = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volume_usage_audit_period = month {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] zoning_mode = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_concurrency.disable_process_locking = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.auth_section = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.auth_type = password {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.auth_version = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.cache = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.certfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.include_service_catalog = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75390]: INFO cinder.volume.manager [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.insecure = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.interface = public {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.keyfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_password = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcache_username = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.region_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.service_type = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.backend = dogpile.cache.null {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.backend_argument = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.backend_expiration_time = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.config_prefix = cache.oslo {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.debug_cache_backend = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.enable_retry_client = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.enable_socket_keepalive = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.expiration_time = 600 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.hashclient_retry_attempts = 2 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.memcache_dead_retry = 300 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.memcache_pool_maxsize = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.memcache_sasl_enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.password = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.proxies = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.redis_db = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.redis_server = localhost:6379 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.retry_attempts = 2 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.retry_delay = 0.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.socket_keepalive_count = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.socket_keepalive_idle = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.socket_keepalive_interval = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.socket_timeout = 1.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.tls_allowed_ciphers = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.tls_cafile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.tls_certfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.tls_enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.tls_keyfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cache.username = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] coordination.backend_url = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.asyncio_connection = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.asyncio_slave_connection = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.backend = sqlalchemy {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.connection = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.connection_debug = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.connection_parameters = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.connection_recycle_time = 3600 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.connection_trace = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.db_inc_retry_interval = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.db_max_retries = 20 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.db_max_retry_interval = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.db_retry_interval = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.max_overflow = 50 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.max_pool_size = 5 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.max_retries = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.mysql_wsrep_sync_wait = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.pool_timeout = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.retry_interval = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.slave_connection = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.sqlite_synchronous = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.synchronous_reader = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] database.use_db_reconnect = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.connection_string = messaging:// {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.es_doc_type = notification {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.es_scroll_size = 10000 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.es_scroll_time = 2m {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.filter_error_trace = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.hmac_keys = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.sentinel_service_name = mymaster {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.socket_timeout = 0.1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.trace_requests = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler.trace_sqlalchemy = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler_jaeger.process_tags = {} {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler_jaeger.service_name_prefix = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] profiler_otlp.service_name_prefix = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.enforce_new_defaults = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.enforce_scope = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.policy_default_rule = default {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.policy_file = policy.yaml {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] privsep_osbrick.group = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] privsep_osbrick.helper_command = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] privsep_osbrick.user = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_sys_admin.group = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_sys_admin.helper_command = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] cinder_sys_admin.user = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.auth_section = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.auth_type = password {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.cafile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.certfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.collect_timing = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.insecure = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.keyfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.send_service_user_token = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.split_loggers = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] service_user.timeout = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.auth_section = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.auth_type = password {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.certfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.collect_timing = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.insecure = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.keyfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.region_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.split_loggers = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] glance.timeout = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.backend_availability_zone = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.chap_password = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.chap_username = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.disk_geometry = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.driver_client_cert = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.driver_client_cert_key = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.driver_data_namespace = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.driver_use_ssl = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.extra_capabilities = {} {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.filter_function = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.goodness_function = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.iscsi_target_flags = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.iscsi_write_cache = on {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.iser_helper = tgtadm {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.iser_port = 3260 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.lvm_share_target = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.lvm_type = auto {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.num_shell_tries = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.replication_device = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.report_discard_supported = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.reserved_percentage = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.target_helper = tgtadm {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.target_port = 3260 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.target_protocol = iscsi {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.trace_flags = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.unique_fqdn_network = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.use_chap_auth = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_backend_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_clear = zero {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_clear_ionice = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_clear_size = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_reports.file_event_handler = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_reports.log_dir = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.backend_host = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.chap_password = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.chap_username = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.disk_geometry = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.driver_client_cert = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.extra_capabilities = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.filter_function = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.goodness_function = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.iser_helper = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.iser_ip_address = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.iser_port = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.lvm_share_target = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.lvm_type = auto {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.num_shell_tries = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.replication_device = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.report_discard_supported = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.reserved_percentage = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.scst_target_driver = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.storage_protocol = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.target_helper = lioadm {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.target_ip_address = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.target_port = 3260 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.trace_flags = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.use_chap_auth = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_clear = zero {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_clear_size = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] lvmdriver-1.volumes_dir = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:35 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.ssl = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_notifications.driver = [] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_notifications.retry = -1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] key_manager.fixed_key = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.barbican_api_version = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.barbican_endpoint = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.barbican_endpoint_type = public {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.barbican_region_name = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.cafile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.certfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.collect_timing = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.insecure = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.keyfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.number_of_retries = 60 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.retry_delay = 1 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.send_service_user_token = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.split_loggers = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.timeout = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.verify_ssl = True {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican.verify_ssl_path = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.auth_section = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.auth_type = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.cafile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.certfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack sudo[75395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 05 17:11:35 devstack sudo[75395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.collect_timing = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.insecure = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.keyfile = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.split_loggers = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] barbican_service_user.timeout = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.approle_role_id = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.approle_secret_id = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.kv_mountpoint = secret {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.kv_path = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.kv_version = 2 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.namespace = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.root_token_id = **** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.ssl_ca_crt_file = None {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.timeout = 60.0 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.use_ssl = False {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:11:35 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] ******************************************************************************** {{(pid=75194) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 17:11:36 devstack sudo[75395]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:36 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:36 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:36 devstack sudo[75617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:36 devstack sudo[75617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:36 devstack sudo[75617]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:36 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.648s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:36 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:11:36 devstack cinder-volume[75390]: INFO cinder.brick.local_dev.lvm [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 05 17:11:36 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:36 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:36 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:36 devstack sudo[75825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:11:36 devstack sudo[75825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:37 devstack sudo[75825]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:37 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.716s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:37 devstack cinder-volume[75390]: DEBUG cinder.brick.local_dev.lvm [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75390) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 05 17:11:37 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:37 devstack sudo[75964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:37 devstack sudo[75964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:38 devstack sudo[75964]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:38 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.091s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:38 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:38 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:38 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:38 devstack sudo[76168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:38 devstack sudo[76168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:39 devstack sudo[76168]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:39 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:39 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:39 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:39 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:39 devstack sudo[76174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 05 17:11:39 devstack sudo[76174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:39 devstack sudo[76174]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:39 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.644s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:39 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:39 devstack sudo[76178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:11:39 devstack sudo[76178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:40 devstack sudo[76178]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:40 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.803s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:40 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:40 devstack sudo[76181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:11:40 devstack sudo[76181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:41 devstack sudo[76181]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:41 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:41 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:41 devstack sudo[76193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:11:41 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:42 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:42 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.836s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:42 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:42 devstack sudo[76199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:42 devstack sudo[76199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:42 devstack sudo[76199]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:42 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:42 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:42 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:42 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:43 devstack sudo[76207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:43 devstack sudo[76207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:43 devstack sudo[76207]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:43 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:43 devstack cinder-volume[75390]: INFO cinder.volume.drivers.lvm [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 05 17:11:43 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:43 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:43 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:43 devstack sudo[76214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:43 devstack sudo[76214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:44 devstack sudo[76214]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:44 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.809s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:44 devstack cinder-volume[75390]: DEBUG cinder.volume.drivers.lvm [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Updating volume stats {{(pid=75390) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 17:11:44 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:44 devstack sudo[76333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:11:44 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:45 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:45 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:45 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:45 devstack cinder-volume[75194]: DEBUG dbcounter [-] [75194] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75194) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:11:45 devstack sudo[76337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:11:45 devstack sudo[76337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:45 devstack sudo[76337]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:45 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:45 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:45 devstack sudo[76479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:45 devstack sudo[76479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:46 devstack sudo[76479]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:46 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:46 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:46 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:11:46 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:47 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:47 devstack cinder-volume[75390]: INFO cinder.volume.driver [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG cinder.volume.driver [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75390) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG oslo_db.sqlalchemy.engines [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75390) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG dbcounter [-] [75390] Writer thread running {{(pid=75390) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG cinder.db.api [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Building query based on filter {{(pid=75390) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG cinder.image.image_utils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75390) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 17:11:47 devstack cinder-volume[75390]: INFO cinder.keymgr.migration [None req-3e0913fe-b4ad-41ed-9451-ccb35c87a6f6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG cinder.volume.drivers.lvm [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Updating volume stats {{(pid=75390) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:47 devstack sudo[76487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:11:47 devstack sudo[76487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:47 devstack sudo[76487]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:47 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:47 devstack sudo[76494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:11:47 devstack sudo[76494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:48 devstack sudo[76494]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:48 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:48 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:48 devstack sudo[76497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:48 devstack sudo[76497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:49 devstack sudo[76497]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:49 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:49 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:49 devstack sudo[76500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:11:49 devstack sudo[76500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:49 devstack sudo[76500]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:49 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:49 devstack cinder-volume[75390]: DEBUG cinder.manager [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Notifying Schedulers of capabilities ... {{(pid=75390) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:11:49 devstack cinder-volume[75390]: INFO cinder.volume.manager [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Driver initialization completed successfully. Jul 05 17:11:49 devstack cinder-volume[75390]: INFO cinder.manager [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Initiating service 2 cleanup Jul 05 17:11:49 devstack cinder-volume[75390]: INFO cinder.manager [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Service 2 cleanup completed. Jul 05 17:11:49 devstack cinder-volume[75390]: DEBUG cinder.service [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Creating RPC server for service cinder-volume {{(pid=75390) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 17:11:49 devstack cinder-volume[75390]: DEBUG cinder.service [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75390) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 17:11:50 devstack cinder-volume[75390]: INFO cinder.volume.manager [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 05 17:11:50 devstack cinder-volume[75390]: DEBUG cinder.volume.drivers.lvm [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Updating volume stats {{(pid=75390) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 17:11:50 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:50 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:11:50 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:50 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:50 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:50 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:50 devstack sudo[76508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:11:50 devstack sudo[76508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:51 devstack sudo[76508]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:51 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:51 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:51 devstack sudo[76514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:11:51 devstack sudo[76514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:52 devstack sudo[76514]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:52 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:52 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:11:52 devstack sudo[76571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:11:52 devstack sudo[76571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:11:52 devstack sudo[76571]: pam_unix(sudo:session): session closed for user root Jul 05 17:11:52 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:11:52 devstack cinder-volume[75390]: INFO cinder.volume.manager [None req-56c39e7e-a30c-4976-9463-4578334261c2 None None] Driver post RPC initialization completed successfully. Jul 05 17:12:02 devstack cinder-volume[75390]: DEBUG dbcounter [-] [75390] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75390) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:12:02 devstack cinder-volume[75390]: DEBUG dbcounter [-] [75390] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75390) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:12:22 devstack cinder-volume[75390]: DEBUG oslo_service.periodic_task [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running periodic task VolumeManager._thread_info {{(pid=75390) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:12:22 devstack cinder-volume[75390]: DEBUG cinder.volume.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] thread count: 6 {{(pid=75390) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:12:22 devstack cinder-volume[75390]: DEBUG cinder.volume.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] thread info: [<_MainThread(MainThread, started 131943323328640)>, , , , , ] {{(pid=75390) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:13:22 devstack cinder-volume[75390]: DEBUG oslo_service.periodic_task [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75390) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:13:22 devstack cinder-volume[75390]: DEBUG cinder.volume.drivers.lvm [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Updating volume stats {{(pid=75390) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 17:13:22 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:13:22 devstack sudo[79472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:13:22 devstack sudo[79472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:13:23 devstack sudo[79472]: pam_unix(sudo:session): session closed for user root Jul 05 17:13:23 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:13:23 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:13:23 devstack sudo[79823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:13:23 devstack sudo[79823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:13:24 devstack sudo[79823]: pam_unix(sudo:session): session closed for user root Jul 05 17:13:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:13:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:13:24 devstack sudo[80178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:13:24 devstack sudo[80178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:13:24 devstack sudo[80178]: pam_unix(sudo:session): session closed for user root Jul 05 17:13:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:13:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:13:24 devstack sudo[80521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:13:24 devstack sudo[80521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:13:25 devstack sudo[80521]: pam_unix(sudo:session): session closed for user root Jul 05 17:13:25 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:13:25 devstack cinder-volume[75390]: DEBUG cinder.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Notifying Schedulers of capabilities ... {{(pid=75390) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:13:25 devstack cinder-volume[75390]: DEBUG oslo_service.periodic_task [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running periodic task VolumeManager._thread_info {{(pid=75390) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:13:25 devstack cinder-volume[75390]: DEBUG cinder.volume.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] thread count: 6 {{(pid=75390) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:13:25 devstack cinder-volume[75390]: DEBUG cinder.volume.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] thread info: [<_MainThread(MainThread, started 131943323328640)>, , , , , ] {{(pid=75390) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:14:02 devstack cinder-volume[75390]: DEBUG dbcounter [-] [75390] Writing DB stats cinder:SELECT=1 {{(pid=75390) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:14:02 devstack cinder-volume[75390]: DEBUG dbcounter [-] [75390] Writing DB stats cinder:UPDATE=1 {{(pid=75390) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:14:22 devstack cinder-volume[75390]: DEBUG oslo_service.periodic_task [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75390) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:14:22 devstack cinder-volume[75390]: DEBUG cinder.volume.drivers.lvm [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Updating volume stats {{(pid=75390) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 17:14:22 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:14:22 devstack sudo[82737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:14:22 devstack sudo[82737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:14:23 devstack sudo[82737]: pam_unix(sudo:session): session closed for user root Jul 05 17:14:23 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:14:23 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:14:23 devstack sudo[82758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:14:23 devstack sudo[82758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:14:24 devstack sudo[82758]: pam_unix(sudo:session): session closed for user root Jul 05 17:14:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:14:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:14:24 devstack sudo[82777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:14:24 devstack sudo[82777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:14:24 devstack sudo[82777]: pam_unix(sudo:session): session closed for user root Jul 05 17:14:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:14:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:14:24 devstack sudo[82802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:14:24 devstack sudo[82802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:14:25 devstack sudo[82802]: pam_unix(sudo:session): session closed for user root Jul 05 17:14:25 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:14:25 devstack cinder-volume[75390]: DEBUG cinder.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Notifying Schedulers of capabilities ... {{(pid=75390) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:14:25 devstack cinder-volume[75390]: DEBUG oslo_service.periodic_task [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running periodic task VolumeManager._thread_info {{(pid=75390) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:14:25 devstack cinder-volume[75390]: DEBUG cinder.volume.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] thread count: 6 {{(pid=75390) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:14:25 devstack cinder-volume[75390]: DEBUG cinder.volume.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] thread info: [<_MainThread(MainThread, started 131943323328640)>, , , , , ] {{(pid=75390) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:15:22 devstack cinder-volume[75390]: DEBUG oslo_service.periodic_task [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75390) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:15:22 devstack cinder-volume[75390]: DEBUG cinder.volume.drivers.lvm [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Updating volume stats {{(pid=75390) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 17:15:22 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:15:22 devstack sudo[84318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 17:15:22 devstack sudo[84318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:15:23 devstack sudo[84318]: pam_unix(sudo:session): session closed for user root Jul 05 17:15:23 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:15:23 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:15:23 devstack sudo[84344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:15:23 devstack sudo[84344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:15:24 devstack sudo[84344]: pam_unix(sudo:session): session closed for user root Jul 05 17:15:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:15:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:15:24 devstack sudo[84350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 17:15:24 devstack sudo[84350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:15:24 devstack sudo[84350]: pam_unix(sudo:session): session closed for user root Jul 05 17:15:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:15:24 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:15:24 devstack sudo[84361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 17:15:24 devstack sudo[84361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:15:25 devstack sudo[84361]: pam_unix(sudo:session): session closed for user root Jul 05 17:15:25 devstack cinder-volume[75390]: DEBUG oslo_concurrency.processutils [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75390) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:15:25 devstack cinder-volume[75390]: DEBUG cinder.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Notifying Schedulers of capabilities ... {{(pid=75390) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:15:25 devstack cinder-volume[75390]: DEBUG oslo_service.periodic_task [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] Running periodic task VolumeManager._thread_info {{(pid=75390) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:15:25 devstack cinder-volume[75390]: DEBUG cinder.volume.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] thread count: 6 {{(pid=75390) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:15:25 devstack cinder-volume[75390]: DEBUG cinder.volume.manager [None req-264c04f2-4327-4749-a5e8-9669cef0821d None None] thread info: [<_MainThread(MainThread, started 131943323328640)>, , , , , ] {{(pid=75390) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:16:02 devstack cinder-volume[75390]: DEBUG dbcounter [-] [75390] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75390) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:16:13 devstack cinder-volume[75194]: INFO oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Caught SIGTERM, stopping children Jul 05 17:16:13 devstack cinder-volume[75194]: DEBUG oslo_concurrency.lockutils [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Acquiring lock "singleton_lock" {{(pid=75194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 17:16:13 devstack cinder-volume[75194]: DEBUG oslo_concurrency.lockutils [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Acquired lock "singleton_lock" {{(pid=75194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 17:16:13 devstack cinder-volume[75194]: DEBUG oslo_concurrency.lockutils [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Releasing lock "singleton_lock" {{(pid=75194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 17:16:13 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Stop services. {{(pid=75194) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 17:16:13 devstack cinder-volume[75194]: DEBUG oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Killing children. {{(pid=75194) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 17:16:13 devstack cinder-volume[75194]: INFO oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Waiting on 1 children to exit Jul 05 17:16:15 devstack cinder-volume[75390]: DEBUG oslo_concurrency.lockutils [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Acquiring lock "singleton_lock" {{(pid=75390) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 17:16:15 devstack cinder-volume[75390]: DEBUG oslo_concurrency.lockutils [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Acquired lock "singleton_lock" {{(pid=75390) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 17:16:15 devstack cinder-volume[75390]: DEBUG oslo_concurrency.lockutils [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Releasing lock "singleton_lock" {{(pid=75390) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 17:16:15 devstack cinder-volume[75390]: WARNING amqp [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 17:16:15 devstack cinder-volume[75390]: WARNING amqp [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 17:16:15 devstack cinder-volume[75194]: INFO oslo_service.backend._eventlet.service [None req-54f2da61-0139-4f4a-93be-ace4c1054aa8 None None] Child 75390 exited with status 0 Jul 05 17:16:15 devstack cinder-volume[85473]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 17:16:15 devstack cinder-volume[85473]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 17:16:15 devstack cinder-volume[85473]: we strongly recommend against using it for new projects. Jul 05 17:16:15 devstack cinder-volume[85473]: If you are already using Eventlet, we recommend migrating to a different Jul 05 17:16:15 devstack cinder-volume[85473]: framework. For more detail see Jul 05 17:16:15 devstack cinder-volume[85473]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 17:16:15 devstack cinder-volume[85473]: import eventlet # noqa Jul 05 17:16:17 devstack cinder-volume[85473]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 17:16:17 devstack cinder-volume[85473]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 17:16:17 devstack cinder-volume[85473]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 17:16:18 devstack cinder-volume[85473]: INFO dbcounter [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Registered counter for database cinder Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_db.sqlalchemy.engines [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85473) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG dbcounter [-] [85473] Writer thread running {{(pid=85473) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 17:16:18 devstack cinder-volume[85473]: INFO cinder.rpc [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 17:16:18 devstack cinder-volume[85473]: INFO cinder.rpc [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_db.sqlalchemy.engines [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85473) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:16:18 devstack cinder-volume[85473]: INFO cinder.volume.manager [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Determined volume DB was empty at startup. Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG cinder.volume.manager [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85473) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 17:16:18 devstack cinder-volume[85473]: INFO cinder.volume.manager [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 17:16:18 devstack cinder-volume[85473]: WARNING stevedore.named [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 17:16:18 devstack cinder-volume[85473]: WARNING castellan.key_manager [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 17:16:18 devstack cinder-volume[85473]: WARNING cinder.keymgr.conf_key_mgr [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 17:16:18 devstack cinder-volume[85473]: INFO cinder.volume.manager [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_db.sqlalchemy.engines [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85473) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:16:18 devstack cinder-volume[85473]: INFO oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Starting 1 workers Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Started child 85690 {{(pid=85473) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Full set of CONF: {{(pid=85473) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] ******************************************************************************** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Configuration options gathered from: {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] ================================================================================ {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] allow_availability_zone_fallback = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] allow_compression_on_image_upload = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] allowed_direct_url_schemes = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] api_rate_limit = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] auth_strategy = keystone {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_availability_zone = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85690]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_host = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_stats_polling_interval = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backup_api_class = cinder.backup.api.API {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backup_name_template = backup-%s {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backup_use_same_host = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backup_use_temp_snapshot = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] chap_password = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] chap_username = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_internal_tenant_project_id = 3b520bc756394f5aba60524d1daf8878 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_internal_tenant_user_id = 207776b17d34446fb1b266b8a85b2415 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cluster = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] compression_format = gzip {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] compute_api_class = cinder.compute.nova.API {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] config_dir = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] config_source = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] control_exchange = openstack {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] debug = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] default_availability_zone = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] default_group_type = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] default_volume_type = QuobyteHD {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] disk_geometry = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] driver_client_cert = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] driver_client_cert_key = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] driver_data_namespace = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] driver_ssl_cert_path = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] driver_ssl_cert_verify = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] driver_use_ssl = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] enable_new_services = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] enable_unsupported_driver = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] enabled_backends = ['QuobyteHD'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] enforce_multipath_for_image_xfer = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] filter_function = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_api_insecure = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_api_ssl_compression = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_ca_certificates_file = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_catalog_info = image:glance:publicURL {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_certfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_keyfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_num_retries = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance_request_timeout = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] goodness_function = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] graceful_shutdown_timeout = 5 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] group_api_class = cinder.group.api.API {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] host = devstack {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_compress_on_upload = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_conversion_address_space_limit = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_conversion_cpu_limit = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_conversion_disable = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_upload_use_cinder_backend = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_upload_use_internal_tenant = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_volume_cache_enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_volume_cache_max_count = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] image_volume_cache_max_size_gb = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] init_host_max_objects_retrieval = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] instance_format = [instance: %(uuid)s] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] iscsi_target_flags = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] iscsi_write_cache = on {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] iser_helper = tgtadm {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] iser_ip_address = 192.168.122.181 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] iser_port = 3260 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_color = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_config_append = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_dir = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_file = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_options = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_rotate_interval = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_rotate_interval_type = days {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] log_rotation_type = none {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] max_age = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85690]: INFO cinder.volume.manager [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 17:16:18 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.remotefs [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85690) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] max_logfile_count = 30 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] max_logfile_size_mb = 200 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] max_over_subscription_ratio = 20.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] message_reap_interval = 86400 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] message_ttl = 2592000 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] migration_create_volume_timeout_secs = 300 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] monkey_patch = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] monkey_patch_modules = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] my_ip = 192.168.122.181 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] no_snapshot_gb_quota = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] num_iser_scan_tries = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] num_shell_tries = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] num_volume_device_scan_tries = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] nvmeof_conn_info_version = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] nvmet_ns_id = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] nvmet_port_id = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] osapi_max_limit = 1000 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] osapi_volume_ext_list = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] osapi_volume_listen = 0.0.0.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] osapi_volume_listen_port = 8776 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] osapi_volume_use_ssl = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] osapi_volume_workers = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] per_volume_size_limit = -1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] periodic_fuzzy_delay = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] periodic_interval = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] project_id_regex = [0-9a-f\-]+ {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] public_endpoint = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] publish_errors = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] quota_backup_gigabytes = 1000 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] quota_backups = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] quota_gigabytes = 1000 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] quota_groups = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] quota_snapshots = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] quota_volumes = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] rate_limit_burst = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] rate_limit_except_level = CRITICAL {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] rate_limit_interval = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] reinit_driver_count = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] replication_device = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] report_discard_supported = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] report_interval = 120 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] reservation_clean_interval = 86400 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] reservation_expire = 86400 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] reserved_image_namespaces = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] reserved_percentage = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] rpc_response_timeout = 120 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] run_external_periodic_tasks = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] scst_target_driver = iscsi {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] scst_target_iqn_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_down_time = 720 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] shell_completion = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] snapshot_name_template = snapshot-%s {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] split_loggers = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] state_path = /opt/stack/data/cinder {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] storage_availability_zone = nova {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] storage_protocol = iSCSI {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] syslog_log_facility = LOG_USER {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] target_helper = lioadm {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] target_ip_address = 192.168.122.181 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] target_port = 3260 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] target_protocol = iscsi {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] target_secondary_ip_addresses = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] trace_flags = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] transfer_api_class = cinder.transfer.api.API {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] transport_url = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] until_refresh = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] use_chap_auth = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] use_default_quota_class = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] use_journal = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] use_json = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] use_multipath_for_image_xfer = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] use_stderr = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] use_syslog = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] verify_glance_signatures = enabled {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_api_class = cinder.volume.api.API {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:18 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_backend_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_clear = zero {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_clear_ionice = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_clear_size = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_copy_bps_limit = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_dd_blocksize = 1M {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_name_template = volume-%s {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_service_inithost_offload = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volume_usage_audit_period = month {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] zoning_mode = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_concurrency.disable_process_locking = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.auth_section = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.auth_type = password {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.auth_version = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.cache = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.certfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.delay_auth_decision = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.http_connect_timeout = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.include_service_catalog = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.insecure = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.interface = public {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.keyfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_password = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcache_username = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.region_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.service_token_roles_required = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.service_type = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.token_cache_time = 300 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.backend = dogpile.cache.null {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.backend_argument = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.backend_expiration_time = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.config_prefix = cache.oslo {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.debug_cache_backend = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.enable_retry_client = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.enable_socket_keepalive = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.expiration_time = 600 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.hashclient_retry_attempts = 2 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.memcache_dead_retry = 300 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.memcache_pool_maxsize = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.memcache_sasl_enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.password = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.proxies = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.redis_db = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.redis_sentinel_service_name = mymaster {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.redis_server = localhost:6379 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.retry_attempts = 2 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.retry_delay = 0.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.socket_keepalive_count = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.socket_keepalive_idle = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.socket_keepalive_interval = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.socket_timeout = 1.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.tls_allowed_ciphers = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.tls_cafile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.tls_certfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.tls_enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.tls_keyfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cache.username = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] coordination.backend_url = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.asyncio_connection = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.asyncio_slave_connection = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.backend = sqlalchemy {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85690) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 17:16:19 devstack cinder-volume[85690]: WARNING cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 17:16:19 devstack cinder-volume[85690]: WARNING cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.connection = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.connection_debug = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.connection_parameters = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.connection_recycle_time = 3600 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.connection_trace = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.db_inc_retry_interval = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.db_max_retries = 20 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.db_max_retry_interval = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.db_retry_interval = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Running cmd (subprocess): mount.quobyte {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.max_overflow = 50 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.max_pool_size = 5 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.max_retries = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.mysql_wsrep_sync_wait = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.pool_timeout = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.retry_interval = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.slave_connection = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.sqlite_synchronous = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.synchronous_reader = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] database.use_db_reconnect = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.connection_string = messaging:// {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.es_doc_type = notification {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.es_scroll_size = 10000 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.es_scroll_time = 2m {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.filter_error_trace = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.hmac_keys = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.sentinel_service_name = mymaster {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.socket_timeout = 0.1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.trace_requests = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler.trace_sqlalchemy = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler_jaeger.process_tags = {} {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler_jaeger.service_name_prefix = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] profiler_otlp.service_name_prefix = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.enforce_new_defaults = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.enforce_scope = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.policy_default_rule = default {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.policy_file = policy.yaml {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_policy.remote_timeout = 60.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] privsep_osbrick.group = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] privsep_osbrick.helper_command = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] privsep_osbrick.user = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_sys_admin.group = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_sys_admin.helper_command = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] cinder_sys_admin.user = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.auth_section = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.auth_type = password {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.cafile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.certfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.collect_timing = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.insecure = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.keyfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.send_service_user_token = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.split_loggers = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] service_user.timeout = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.auth_section = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.auth_type = password {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.certfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.collect_timing = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.insecure = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.keyfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.region_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.split_loggers = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] glance.timeout = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.backend_availability_zone = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.chap_password = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.chap_username = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.disk_geometry = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.driver_client_cert = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.driver_client_cert_key = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.driver_data_namespace = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.driver_use_ssl = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.enable_unsupported_driver = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.extra_capabilities = {} {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.filter_function = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.goodness_function = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.iscsi_target_flags = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.iscsi_write_cache = on {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.iser_helper = tgtadm {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.iser_port = 3260 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_host = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_login = admin {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_mount_options = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_password = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_private_key = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_share_path = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_ssh_port = 22 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.num_shell_tries = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.nvmet_port_id = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.quobyte_client_cfg = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.quobyte_volume_url = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.replication_device = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.report_discard_supported = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.reserved_percentage = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.scst_target_driver = iscsi {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.scst_target_iqn_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.storage_protocol = iSCSI {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.target_helper = tgtadm {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.target_port = 3260 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.target_protocol = iscsi {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.trace_flags = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.unique_fqdn_network = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.use_chap_auth = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volume_backend_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volume_clear = zero {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volume_clear_ionice = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volume_clear_size = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_reports.file_event_handler = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_reports.log_dir = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.backend_availability_zone = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.backend_host = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.chap_password = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.chap_username = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.chiscsi_conf = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.disk_geometry = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.driver_client_cert = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.driver_client_cert_key = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.driver_data_namespace = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.driver_use_ssl = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.extra_capabilities = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.filter_function = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.goodness_function = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.iscsi_target_flags = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.iscsi_write_cache = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.iser_helper = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.iser_ip_address = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.iser_port = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.iser_target_prefix = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_host = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_login = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_mount_options = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_password = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_private_key = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_share_path = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_ssh_port = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.num_shell_tries = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nvmet_ns_id = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.nvmet_port_id = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.replication_device = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.report_discard_supported = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.reserved_percentage = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.scst_target_driver = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.storage_protocol = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.target_helper = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.target_ip_address = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.target_port = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.target_prefix = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.target_protocol = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.trace_flags = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.unique_fqdn_network = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.use_chap_auth = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volume_clear = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volume_clear_ionice = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volume_clear_size = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] QuobyteHD.volumes_dir = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.ssl = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.ssl_version = {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_notifications.driver = [] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_notifications.retry = -1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] oslo_messaging_notifications.transport_url = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] key_manager.fixed_key = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.barbican_api_version = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.barbican_endpoint = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.barbican_endpoint_type = public {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.barbican_region_name = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.cafile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.certfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.collect_timing = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.insecure = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.keyfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.number_of_retries = 60 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.retry_delay = 1 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.send_service_user_token = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.split_loggers = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.timeout = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.verify_ssl = True {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican.verify_ssl_path = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.auth_section = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.auth_type = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.cafile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.certfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.collect_timing = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.insecure = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.keyfile = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.split_loggers = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] barbican_service_user.timeout = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.approle_role_id = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.approle_secret_id = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.kv_mountpoint = secret {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.kv_path = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.kv_version = 2 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.namespace = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.root_token_id = **** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.ssl_ca_crt_file = None {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.timeout = 60.0 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.use_ssl = False {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:19 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] ******************************************************************************** {{(pid=85473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 17:16:19 devstack quobyte-client[85691]: Reading configuration file: /etc/quobyte/client.cfg Jul 05 17:16:19 devstack quobyte-client[85691]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 05 17:16:19 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] CMD "mount.quobyte" returned: 1 in 0.180s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:19 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:16:19 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:16:19 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=85690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:16:19 devstack cinder-volume[85690]: INFO cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e ... Jul 05 17:16:19 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 -c /etc/quobyte/client-cinder.cfg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:19 devstack sudo[85696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 -c /etc/quobyte/client-cinder.cfg Jul 05 17:16:19 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:16:20 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.762s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:20 devstack cinder-volume[85690]: INFO cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e succeeded Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=85690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.774s {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:20 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:16:20 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:16:20 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.616s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:20 devstack cinder-volume[85690]: INFO cinder.volume.driver [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Driver hasn't implemented _init_vendor_properties() Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG cinder.volume.driver [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85690) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_db.sqlalchemy.engines [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG dbcounter [-] [85690] Writer thread running {{(pid=85690) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG cinder.db.api [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Building query based on filter {{(pid=85690) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG cinder.image.image_utils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85690) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 17:16:20 devstack cinder-volume[85690]: INFO cinder.keymgr.migration [None req-2659ed68-30dc-418f-966e-fe1806fa3259 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=85690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=85690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:16:20 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:20 devstack sudo[85768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:16:20 devstack sudo[85768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:16:21 devstack sudo[85768]: pam_unix(sudo:session): session closed for user root Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.686s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG cinder.manager [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Notifying Schedulers of capabilities ... {{(pid=85690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:16:21 devstack cinder-volume[85690]: INFO cinder.volume.manager [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Driver initialization completed successfully. Jul 05 17:16:21 devstack cinder-volume[85690]: INFO cinder.manager [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Initiating service 3 cleanup Jul 05 17:16:21 devstack cinder-volume[85690]: INFO cinder.manager [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Service 3 cleanup completed. Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG cinder.service [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Creating RPC server for service cinder-volume {{(pid=85690) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG cinder.service [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85690) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 17:16:21 devstack cinder-volume[85690]: INFO cinder.volume.manager [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=85690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=85690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:16:21 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:21 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:16:21 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:16:22 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Jul 05 17:16:22 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.745s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:22 devstack cinder-volume[85690]: INFO cinder.volume.manager [None req-27e52d62-e416-47a0-918a-1a83d7d7fc4a None None] Driver post RPC initialization completed successfully. Jul 05 17:16:26 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-b1bf41ad-859e-413a-bcfb-f076d6ec5dcc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:16:26 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-b1bf41ad-859e-413a-bcfb-f076d6ec5dcc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:16:26 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf41ad-859e-413a-bcfb-f076d6ec5dcc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=85690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:16:26 devstack cinder-volume[85690]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf41ad-859e-413a-bcfb-f076d6ec5dcc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=85690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:16:26 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-b1bf41ad-859e-413a-bcfb-f076d6ec5dcc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:16:26 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-b1bf41ad-859e-413a-bcfb-f076d6ec5dcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:26 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:16:26 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:16:27 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Jul 05 17:16:27 devstack cinder-volume[85690]: DEBUG oslo_concurrency.processutils [None req-b1bf41ad-859e-413a-bcfb-f076d6ec5dcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.611s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:27 devstack cinder-volume[85690]: DEBUG cinder.manager [None req-b1bf41ad-859e-413a-bcfb-f076d6ec5dcc None None] Notifying Schedulers of capabilities ... {{(pid=85690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:16:28 devstack cinder-volume[85473]: INFO oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Caught SIGTERM, stopping children Jul 05 17:16:28 devstack cinder-volume[85473]: DEBUG oslo_concurrency.lockutils [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Acquiring lock "singleton_lock" {{(pid=85473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 17:16:28 devstack cinder-volume[85473]: DEBUG oslo_concurrency.lockutils [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Acquired lock "singleton_lock" {{(pid=85473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 17:16:28 devstack cinder-volume[85473]: DEBUG oslo_concurrency.lockutils [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Releasing lock "singleton_lock" {{(pid=85473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 17:16:28 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Stop services. {{(pid=85473) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 17:16:28 devstack cinder-volume[85473]: DEBUG oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Killing children. {{(pid=85473) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 17:16:28 devstack cinder-volume[85473]: INFO oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Waiting on 1 children to exit Jul 05 17:16:29 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Acquiring lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 17:16:29 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Acquired lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 17:16:29 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Releasing lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 17:16:29 devstack cinder-volume[85690]: WARNING amqp [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 17:16:29 devstack cinder-volume[85690]: WARNING amqp [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 17:16:29 devstack cinder-volume[85473]: INFO oslo_service.backend._eventlet.service [None req-500931d0-51f3-4d88-9455-6d08eb6bb5ee None None] Child 85690 exited with status 0 Jul 05 17:16:30 devstack cinder-volume[86118]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 17:16:30 devstack cinder-volume[86118]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 17:16:30 devstack cinder-volume[86118]: we strongly recommend against using it for new projects. Jul 05 17:16:30 devstack cinder-volume[86118]: If you are already using Eventlet, we recommend migrating to a different Jul 05 17:16:30 devstack cinder-volume[86118]: framework. For more detail see Jul 05 17:16:30 devstack cinder-volume[86118]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 17:16:30 devstack cinder-volume[86118]: import eventlet # noqa Jul 05 17:16:33 devstack cinder-volume[86118]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 17:16:33 devstack cinder-volume[86118]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 17:16:33 devstack cinder-volume[86118]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 17:16:34 devstack cinder-volume[86118]: INFO dbcounter [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Registered counter for database cinder Jul 05 17:16:34 devstack cinder-volume[86118]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:16:34 devstack cinder-volume[86118]: DEBUG dbcounter [-] [86118] Writer thread running {{(pid=86118) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 17:16:34 devstack cinder-volume[86118]: INFO cinder.rpc [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 17:16:34 devstack cinder-volume[86118]: INFO cinder.rpc [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 17:16:34 devstack cinder-volume[86118]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:16:35 devstack cinder-volume[86118]: INFO cinder.volume.manager [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Determined volume DB was empty at startup. Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG cinder.volume.manager [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86118) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 17:16:35 devstack cinder-volume[86118]: WARNING stevedore.named [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 17:16:35 devstack cinder-volume[86118]: WARNING castellan.key_manager [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 17:16:35 devstack cinder-volume[86118]: WARNING cinder.keymgr.conf_key_mgr [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 17:16:35 devstack cinder-volume[86118]: INFO cinder.volume.manager [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:16:35 devstack cinder-volume[86118]: INFO oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Starting 1 workers Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Started child 86459 {{(pid=86118) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Full set of CONF: {{(pid=86118) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] ******************************************************************************** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] Configuration options gathered from: {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] ================================================================================ {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] allow_availability_zone_fallback = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] allow_compression_on_image_upload = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] allowed_direct_url_schemes = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] api_rate_limit = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] auth_strategy = keystone {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_availability_zone = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_host = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_stats_polling_interval = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backup_api_class = cinder.backup.api.API {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backup_name_template = backup-%s {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86459]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backup_use_same_host = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backup_use_temp_snapshot = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] chap_password = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] chap_username = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_internal_tenant_project_id = 3b520bc756394f5aba60524d1daf8878 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_internal_tenant_user_id = 207776b17d34446fb1b266b8a85b2415 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cluster = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] compression_format = gzip {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] compute_api_class = cinder.compute.nova.API {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] config_dir = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] config_source = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] control_exchange = openstack {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] debug = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] default_availability_zone = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] default_group_type = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] default_volume_type = QuobyteHD {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] disk_geometry = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] driver_client_cert = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] driver_client_cert_key = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] driver_data_namespace = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] driver_ssl_cert_path = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] driver_ssl_cert_verify = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] driver_use_ssl = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] enable_new_services = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] enable_unsupported_driver = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] enabled_backends = ['QuobyteHD'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] enforce_multipath_for_image_xfer = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] filter_function = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_api_insecure = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_api_ssl_compression = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_ca_certificates_file = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_catalog_info = image:glance:publicURL {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_certfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_keyfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_num_retries = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance_request_timeout = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] goodness_function = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] graceful_shutdown_timeout = 5 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] group_api_class = cinder.group.api.API {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] host = devstack {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_compress_on_upload = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_conversion_address_space_limit = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_conversion_cpu_limit = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_conversion_disable = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_upload_use_cinder_backend = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_upload_use_internal_tenant = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_volume_cache_enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_volume_cache_max_count = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] image_volume_cache_max_size_gb = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] init_host_max_objects_retrieval = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] instance_format = [instance: %(uuid)s] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86459) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] iscsi_target_flags = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] iscsi_write_cache = on {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] iser_helper = tgtadm {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] iser_ip_address = 192.168.122.181 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] iser_port = 3260 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_color = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_config_append = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_dir = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_file = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_options = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_rotate_interval = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_rotate_interval_type = days {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] log_rotation_type = none {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] max_age = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] max_logfile_count = 30 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] max_logfile_size_mb = 200 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] max_over_subscription_ratio = 20.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] message_reap_interval = 86400 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] message_ttl = 2592000 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] migration_create_volume_timeout_secs = 300 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] monkey_patch = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] monkey_patch_modules = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] my_ip = 192.168.122.181 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] no_snapshot_gb_quota = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] num_iser_scan_tries = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] num_shell_tries = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] num_volume_device_scan_tries = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] nvmeof_conn_info_version = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] nvmet_ns_id = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] nvmet_port_id = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] osapi_max_limit = 1000 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] osapi_volume_ext_list = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] osapi_volume_listen = 0.0.0.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] osapi_volume_listen_port = 8776 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] osapi_volume_use_ssl = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] osapi_volume_workers = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] per_volume_size_limit = -1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] periodic_fuzzy_delay = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] periodic_interval = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] project_id_regex = [0-9a-f\-]+ {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] public_endpoint = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] publish_errors = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] quota_backup_gigabytes = 1000 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] quota_backups = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] quota_gigabytes = 1000 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] quota_groups = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] quota_snapshots = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] quota_volumes = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] rate_limit_burst = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] rate_limit_except_level = CRITICAL {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] rate_limit_interval = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] reinit_driver_count = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] replication_device = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] report_discard_supported = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] report_interval = 120 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] reservation_clean_interval = 86400 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] reservation_expire = 86400 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] reserved_image_namespaces = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] reserved_percentage = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] rpc_response_timeout = 120 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] run_external_periodic_tasks = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] scst_target_driver = iscsi {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] scst_target_iqn_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_down_time = 720 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] shell_completion = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] snapshot_name_template = snapshot-%s {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] split_loggers = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] state_path = /opt/stack/data/cinder {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] storage_availability_zone = nova {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] storage_protocol = iSCSI {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] syslog_log_facility = LOG_USER {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] target_helper = lioadm {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] target_ip_address = 192.168.122.181 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] target_port = 3260 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] target_protocol = iscsi {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] target_secondary_ip_addresses = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] trace_flags = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] transfer_api_class = cinder.transfer.api.API {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] transport_url = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] until_refresh = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] use_chap_auth = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] use_default_quota_class = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] use_journal = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] use_json = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] use_multipath_for_image_xfer = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] use_stderr = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] use_syslog = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] verify_glance_signatures = enabled {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_api_class = cinder.volume.api.API {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_backend_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_clear = zero {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_clear_ionice = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_clear_size = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_copy_bps_limit = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_dd_blocksize = 1M {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_name_template = volume-%s {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_service_inithost_offload = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volume_usage_audit_period = month {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] zoning_mode = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_concurrency.disable_process_locking = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.auth_section = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.auth_type = password {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.auth_version = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.cache = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.certfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.delay_auth_decision = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.http_connect_timeout = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:35 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.include_service_catalog = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.insecure = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.interface = public {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.keyfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_password = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcache_username = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.region_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.service_token_roles_required = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.service_type = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.token_cache_time = 300 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.backend = dogpile.cache.null {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.backend_argument = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.backend_expiration_time = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.config_prefix = cache.oslo {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.debug_cache_backend = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.enable_retry_client = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.enable_socket_keepalive = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.expiration_time = 600 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.hashclient_retry_attempts = 2 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.memcache_dead_retry = 300 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.memcache_pool_maxsize = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.memcache_sasl_enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86459) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 17:16:36 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 17:16:36 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.password = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.proxies = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.redis_db = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.redis_sentinel_service_name = mymaster {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.redis_server = localhost:6379 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.retry_attempts = 2 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.retry_delay = 0.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.socket_keepalive_count = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.socket_keepalive_idle = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.socket_keepalive_interval = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.socket_timeout = 1.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.tls_allowed_ciphers = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Running cmd (subprocess): mount.quobyte {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.tls_cafile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.tls_certfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.tls_enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.tls_keyfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cache.username = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] coordination.backend_url = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.asyncio_connection = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.asyncio_slave_connection = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.backend = sqlalchemy {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.connection = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.connection_debug = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.connection_parameters = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.connection_recycle_time = 3600 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.connection_trace = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.db_inc_retry_interval = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.db_max_retries = 20 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.db_max_retry_interval = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.db_retry_interval = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.max_overflow = 50 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.max_pool_size = 5 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.max_retries = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.mysql_wsrep_sync_wait = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.pool_timeout = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.retry_interval = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.slave_connection = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.sqlite_synchronous = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.synchronous_reader = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] database.use_db_reconnect = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.connection_string = messaging:// {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.es_doc_type = notification {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.es_scroll_size = 10000 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.es_scroll_time = 2m {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.filter_error_trace = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.hmac_keys = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.sentinel_service_name = mymaster {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.socket_timeout = 0.1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.trace_requests = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler.trace_sqlalchemy = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler_jaeger.process_tags = {} {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler_jaeger.service_name_prefix = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] profiler_otlp.service_name_prefix = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.enforce_new_defaults = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.enforce_scope = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.policy_default_rule = default {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.policy_file = policy.yaml {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_policy.remote_timeout = 60.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] privsep_osbrick.group = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] privsep_osbrick.helper_command = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] privsep_osbrick.user = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_sys_admin.group = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_sys_admin.helper_command = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] cinder_sys_admin.user = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.auth_section = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.auth_type = password {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.cafile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.certfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.collect_timing = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.insecure = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.keyfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.send_service_user_token = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.split_loggers = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] service_user.timeout = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.auth_section = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.auth_type = password {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.certfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.collect_timing = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.insecure = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.keyfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.region_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.split_loggers = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] glance.timeout = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.backend_availability_zone = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.chap_password = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.chap_username = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.disk_geometry = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.driver_client_cert = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.driver_client_cert_key = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.driver_data_namespace = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.driver_use_ssl = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.enable_unsupported_driver = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.extra_capabilities = {} {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.filter_function = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.goodness_function = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.iscsi_target_flags = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.iscsi_write_cache = on {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.iser_helper = tgtadm {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.iser_port = 3260 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_host = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_login = admin {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_mount_options = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_password = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_private_key = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_share_path = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_ssh_port = 22 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.num_shell_tries = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.nvmet_port_id = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.quobyte_client_cfg = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.quobyte_volume_url = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.replication_device = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.report_discard_supported = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.reserved_percentage = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.scst_target_driver = iscsi {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.scst_target_iqn_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.storage_protocol = iSCSI {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.target_helper = tgtadm {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.target_port = 3260 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.target_protocol = iscsi {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.trace_flags = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.unique_fqdn_network = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.use_chap_auth = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volume_backend_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volume_clear = zero {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volume_clear_ionice = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volume_clear_size = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_reports.file_event_handler = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_reports.log_dir = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.backend_availability_zone = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.backend_host = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.chap_password = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.chap_username = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.chiscsi_conf = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.disk_geometry = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.driver_client_cert = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.driver_client_cert_key = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.driver_data_namespace = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.driver_use_ssl = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.extra_capabilities = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.filter_function = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.goodness_function = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.iscsi_target_flags = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.iscsi_write_cache = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.iser_helper = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.iser_ip_address = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.iser_port = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.iser_target_prefix = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_host = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_login = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_mount_options = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_password = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_private_key = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_share_path = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_ssh_port = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.num_shell_tries = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nvmet_ns_id = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.nvmet_port_id = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.replication_device = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.report_discard_supported = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.reserved_percentage = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.scst_target_driver = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.storage_protocol = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.target_helper = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.target_ip_address = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.target_port = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.target_prefix = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.target_protocol = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.trace_flags = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.unique_fqdn_network = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.use_chap_auth = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volume_clear = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volume_clear_ionice = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volume_clear_size = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] CMD "mount.quobyte" returned: 1 in 0.170s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] QuobyteHD.volumes_dir = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.ssl = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.ssl_version = {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_notifications.driver = [] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_notifications.retry = -1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] oslo_messaging_notifications.transport_url = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] key_manager.fixed_key = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.barbican_api_version = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.barbican_endpoint = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.barbican_endpoint_type = public {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.barbican_region_name = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.cafile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.certfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.collect_timing = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.insecure = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.keyfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.number_of_retries = 60 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.retry_delay = 1 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.send_service_user_token = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.split_loggers = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.timeout = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.verify_ssl = True {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican.verify_ssl_path = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.auth_section = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.auth_type = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.cafile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.certfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.collect_timing = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.insecure = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.keyfile = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.split_loggers = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] barbican_service_user.timeout = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.approle_role_id = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.approle_secret_id = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.kv_mountpoint = secret {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.kv_path = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.kv_version = 2 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.namespace = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.root_token_id = **** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.ssl_ca_crt_file = None {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.timeout = 60.0 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.use_ssl = False {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 17:16:36 devstack cinder-volume[86118]: DEBUG oslo_service.backend._eventlet.service [None req-1dc38c46-1ee4-4ca6-b41c-5416893cffaa None None] ******************************************************************************** {{(pid=86118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 17:16:37 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.203s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:37 devstack cinder-volume[86459]: INFO cinder.volume.driver [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG cinder.volume.driver [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86459) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG oslo_db.sqlalchemy.engines [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86459) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writer thread running {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG cinder.db.api [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Building query based on filter {{(pid=86459) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86459) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:37 devstack cinder-volume[86459]: INFO cinder.keymgr.migration [None req-ac1a4b12-4122-4595-ae4c-e9975a44e448 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 17:16:37 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:16:37 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:16:37 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.646s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:16:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Driver initialization completed successfully. Jul 05 17:16:37 devstack cinder-volume[86459]: INFO cinder.manager [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Initiating service 3 cleanup Jul 05 17:16:37 devstack cinder-volume[86459]: INFO cinder.manager [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Service 3 cleanup completed. Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG cinder.service [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Creating RPC server for service cinder-volume {{(pid=86459) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 17:16:37 devstack cinder-volume[86459]: DEBUG cinder.service [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86459) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 17:16:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 17:16:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:16:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:16:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:16:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:16:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:16:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:16:38 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:16:38 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:16:38 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Jul 05 17:16:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.646s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:16:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-36704342-7c3a-45eb-bacc-1cf1013a6615 None None] Driver post RPC initialization completed successfully. Jul 05 17:16:45 devstack cinder-volume[86118]: DEBUG dbcounter [-] [86118] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86118) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:16:47 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:16:48 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:16:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:16:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 6 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:16:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Flow 'volume_create_manager' (e62d1f7c-89aa-435f-a2dc-97c0b983c787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb209ce0-fe92-4321-96c8-ebaa31948a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb209ce0-fe92-4321-96c8-ebaa31948a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1065876587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0b0fd1-201a-4384-9f3d-7b48777f09ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdb8300c17043b695c3b45e061f799a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:17:38Z,use_quota=True,user_id='a4b2fc776dcf4372b1f0d7ce4dda50ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a9c4ff-a775-42d1-9563-4a83e124fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a9c4ff-a775-42d1-9563-4a83e124fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b942ca-d21b-4386-bd19-011df355582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b942ca-d21b-4386-bd19-011df355582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0b0fd1-201a-4384-9f3d-7b48777f09ac', 'volume_name': 'volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55289bda-2662-4296-b55f-fa5474f3f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55289bda-2662-4296-b55f-fa5474f3f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf91f18-0cbe-4e3a-9957-190878ed245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:17:37 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Volume ef0b0fd1-201a-4384-9f3d-7b48777f09ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac', 'volume_size': 1} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1065876587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0b0fd1-201a-4384-9f3d-7b48777f09ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdb8300c17043b695c3b45e061f799a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:17:38Z,use_quota=True,user_id='a4b2fc776dcf4372b1f0d7ce4dda50ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Creating volume ef0b0fd1-201a-4384-9f3d-7b48777f09ac {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:17:37 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:17:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:17:37 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac 1073741824 Jul 05 17:17:37 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:17:39 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Jul 05 17:17:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac 1073741824" returned: 0 in 1.344s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:17:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:17:39 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac Jul 05 17:17:39 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:17:40 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Jul 05 17:17:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac" returned: 0 in 0.828s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:17:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:17:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:17:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf91f18-0cbe-4e3a-9957-190878ed245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:17:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146eda30-9757-4d7f-b27d-4ee41826ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:17:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Volume volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac (ef0b0fd1-201a-4384-9f3d-7b48777f09ac): created successfully Jul 05 17:17:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146eda30-9757-4d7f-b27d-4ee41826ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:17:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Flow 'volume_create_manager' (e62d1f7c-89aa-435f-a2dc-97c0b983c787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:17:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-707f8c08-11f5-406c-876d-434d80c89594 tempest-TaggedAttachmentsTest-590563988 None] Created volume successfully. Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:17:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:17:50 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:17:50 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:17:51 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Jul 05 17:17:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.110s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:17:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:17:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:17:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 6 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:17:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:17:59 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:17:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Flow 'volume_create_manager' (49375c86-b8f3-44f9-8c3b-5d54fb74f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:17:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eed4c64-0720-460a-ad44-e9049dde1954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:17:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eed4c64-0720-460a-ad44-e9049dde1954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1320317334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b94c7a9-95f5-4e69-b487-28286211662e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed50b524cf14c9f88e30552da1f19db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:18:00Z,use_quota=True,user_id='c008802bbfd6436c8033ec2719bd3737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:17:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2815c4ab-40ad-4c9b-b336-13b87d5a8aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2815c4ab-40ad-4c9b-b336-13b87d5a8aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c00ca8-52d9-41ed-87fc-a6b7907ac008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c00ca8-52d9-41ed-87fc-a6b7907ac008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b94c7a9-95f5-4e69-b487-28286211662e', 'volume_name': 'volume-3b94c7a9-95f5-4e69-b487-28286211662e', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35262787-0a24-40cf-b6a3-eb00f768a7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35262787-0a24-40cf-b6a3-eb00f768a7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a201050e-640b-41e6-9661-46cfb365af1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:00 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Volume 3b94c7a9-95f5-4e69-b487-28286211662e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b94c7a9-95f5-4e69-b487-28286211662e', 'volume_size': 1} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1320317334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b94c7a9-95f5-4e69-b487-28286211662e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed50b524cf14c9f88e30552da1f19db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:18:00Z,use_quota=True,user_id='c008802bbfd6436c8033ec2719bd3737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Creating volume 3b94c7a9-95f5-4e69-b487-28286211662e {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:18:00 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:18:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:00 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e 1073741824 Jul 05 17:18:00 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:01 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e 1073741824" returned: 0 in 1.788s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:02 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e Jul 05 17:18:02 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Flow 'volume_create_manager' (d1f9e328-c2ca-47d1-992e-11f6ad466b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca38a7b3-2c5e-4033-bfc2-715706f82875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca38a7b3-2c5e-4033-bfc2-715706f82875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1494018262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09645c72-74e1-483f-a946-3b8e7558e44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3ed9fae0054da9b4ccebfed5188158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:18:02Z,use_quota=True,user_id='bf0547b561e54e0380c3845130f33989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d241722a-135d-4865-b5c0-eba4571b46ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d241722a-135d-4865-b5c0-eba4571b46ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cb074b-db63-4349-b00e-910d0bdcc303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cb074b-db63-4349-b00e-910d0bdcc303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09645c72-74e1-483f-a946-3b8e7558e44d', 'volume_name': 'volume-09645c72-74e1-483f-a946-3b8e7558e44d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76259c9-ea8e-4f07-b4af-dc564e901117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76259c9-ea8e-4f07-b4af-dc564e901117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc25af8-1f1b-4a22-8f47-f54cfe3afe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:02 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Volume 09645c72-74e1-483f-a946-3b8e7558e44d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09645c72-74e1-483f-a946-3b8e7558e44d', 'volume_size': 1} Jul 05 17:18:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:18:03 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e" returned: 0 in 1.394s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] <== create_volume: return (3279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.281s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1494018262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09645c72-74e1-483f-a946-3b8e7558e44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3ed9fae0054da9b4ccebfed5188158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:18:02Z,use_quota=True,user_id='bf0547b561e54e0380c3845130f33989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Creating volume 09645c72-74e1-483f-a946-3b8e7558e44d {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:18:03 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a201050e-640b-41e6-9661-46cfb365af1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b94c7a9-95f5-4e69-b487-28286211662e', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:03 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d 1073741824 Jul 05 17:18:03 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2410503d-3648-4938-a228-2e5a9ccf3d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:03 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Volume volume-3b94c7a9-95f5-4e69-b487-28286211662e (3b94c7a9-95f5-4e69-b487-28286211662e): created successfully Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2410503d-3648-4938-a228-2e5a9ccf3d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Flow 'volume_create_manager' (49375c86-b8f3-44f9-8c3b-5d54fb74f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:18:03 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-82800cbd-61c7-4c21-a2f7-939e355bfed6 tempest-DeleteServersTestJSON-1942059729 None] Created volume successfully. Jul 05 17:18:05 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d 1073741824" returned: 0 in 1.966s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:05 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d Jul 05 17:18:05 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:07 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d" returned: 0 in 1.527s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] <== create_volume: return (3664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:18:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.669s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:18:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc25af8-1f1b-4a22-8f47-f54cfe3afe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09645c72-74e1-483f-a946-3b8e7558e44d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0d2046-d440-4672-a475-c53f9eface0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:18:07 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Volume volume-09645c72-74e1-483f-a946-3b8e7558e44d (09645c72-74e1-483f-a946-3b8e7558e44d): created successfully Jul 05 17:18:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0d2046-d440-4672-a475-c53f9eface0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:18:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Flow 'volume_create_manager' (d1f9e328-c2ca-47d1-992e-11f6ad466b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:18:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7f83421b-4dc7-4250-8507-0e79689d1740 tempest-VolumesAdminNegativeTest-559251949 None] Created volume successfully. Jul 05 17:18:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Acquiring lock "cinder-09645c72-74e1-483f-a946-3b8e7558e44d-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:18:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Lock "cinder-09645c72-74e1-483f-a946-3b8e7558e44d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:18:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Acquiring lock "cinder-quobyte-09645c72-74e1-483f-a946-3b8e7558e44d" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:18:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Lock "cinder-quobyte-09645c72-74e1-483f-a946-3b8e7558e44d" acquired by "delete_volume" :: waited 0.057s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:18:09 devstack cinder-volume[86459]: INFO oslo.privsep.daemon [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpscuuszua/privsep.sock'] Jul 05 17:18:09 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpscuuszua/privsep.sock Jul 05 17:18:09 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 17:18:10 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 17:18:11 devstack cinder-volume[86459]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 17:18:12 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:12 devstack cinder-volume[86459]: INFO oslo.privsep.daemon [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Spawned new privsep daemon via rootwrap Jul 05 17:18:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Accepted privsep connection to /tmp/tmpscuuszua/privsep.sock {{(pid=86459) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 05 17:18:12 devstack cinder-volume[86459]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 05 17:18:12 devstack cinder-volume[86459]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 05 17:18:12 devstack cinder-volume[86459]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 05 17:18:12 devstack cinder-volume[86459]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87482 Jul 05 17:18:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[504abede-f071-4c66-8878-af73bc2256f9]: (2,) {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:18:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bee172-b807-4907-9f2e-005608be66b0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:18:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:12 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d Jul 05 17:18:12 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:13 devstack cinder-volume[86459]: WARNING py.warnings [req-9ee33fa9-5f71-403b-9a21-9d833379b9b5 req-803d2169-86ec-4913-bf86-4b542e854768 tempest-DeleteServersTestJSON-1942059729 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 05 17:18:13 devstack cinder-volume[86459]: .first() Jul 05 17:18:13 devstack cinder-volume[86459]: Jul 05 17:18:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-9ee33fa9-5f71-403b-9a21-9d833379b9b5 req-803d2169-86ec-4913-bf86-4b542e854768 tempest-DeleteServersTestJSON-1942059729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:18:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-9ee33fa9-5f71-403b-9a21-9d833379b9b5 req-803d2169-86ec-4913-bf86-4b542e854768 tempest-DeleteServersTestJSON-1942059729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:18:13 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2da9fd-4f75-42ed-9eb1-0007a68a63fc]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:18:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-9ee33fa9-5f71-403b-9a21-9d833379b9b5 req-803d2169-86ec-4913-bf86-4b542e854768 tempest-DeleteServersTestJSON-1942059729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:14 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d" returned: 0 in 1.950s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:14 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e Jul 05 17:18:14 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:14 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d Jul 05 17:18:14 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:15 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-09645c72-74e1-483f-a946-3b8e7558e44d" returned: 0 in 1.135s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Lock "cinder-quobyte-09645c72-74e1-483f-a946-3b8e7558e44d" released by "delete_volume" :: held 6.166s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:18:15 devstack cinder-volume[86459]: WARNING cinder.quota [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:18:15 devstack cinder-volume[86459]: WARNING cinder.quota [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Created reservations ['f11cf119-6cbd-41ce-9d07-e34e6f041fdc', '880d84a7-b98a-4a4f-9892-4cbe1d37ac6c', '653f4ed0-b677-4e2d-b049-7d2b32186d2d', '8d610722-668d-4214-9968-172b2278a2bd'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:18:15 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-9ee33fa9-5f71-403b-9a21-9d833379b9b5 req-803d2169-86ec-4913-bf86-4b542e854768 tempest-DeleteServersTestJSON-1942059729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e" returned: 0 in 1.958s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-9ee33fa9-5f71-403b-9a21-9d833379b9b5 req-803d2169-86ec-4913-bf86-4b542e854768 tempest-DeleteServersTestJSON-1942059729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.018s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:18:15 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:18:15 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-9ee33fa9-5f71-403b-9a21-9d833379b9b5 req-803d2169-86ec-4913-bf86-4b542e854768 tempest-DeleteServersTestJSON-1942059729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-3b94c7a9-95f5-4e69-b487-28286211662e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf4ed78f-6873-48a4-9d1c-fa0630383385', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:18:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-9ee33fa9-5f71-403b-9a21-9d833379b9b5 req-803d2169-86ec-4913-bf86-4b542e854768 tempest-DeleteServersTestJSON-1942059729 None] attachment_update completed successfully. Jul 05 17:18:17 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.221s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:17 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:18:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Deleted volume successfully. Jul 05 17:18:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-62f3074f-4895-4ab6-a8ac-d3247fa0ddf4 tempest-VolumesAdminNegativeTest-559251949 None] Lock "cinder-09645c72-74e1-483f-a946-3b8e7558e44d-delete_volume" released by "delete_volume" :: held 7.962s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:18:26 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=17,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:18:27 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=16,cinder:SELECT=12,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:18:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-8fd942d2-c567-4fa7-9a92-34de2392cf23 req-117013fb-7406-4caa-9ae2-3952cab534aa tempest-DeleteServersTestJSON-1942059729 None] Terminate volume connection completed successfully. Jul 05 17:18:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-8fd942d2-c567-4fa7-9a92-34de2392cf23 req-117013fb-7406-4caa-9ae2-3952cab534aa tempest-DeleteServersTestJSON-1942059729 None] Deleting attachment cf4ed78f-6873-48a4-9d1c-fa0630383385. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:18:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Acquiring lock "cinder-3b94c7a9-95f5-4e69-b487-28286211662e-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:18:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Lock "cinder-3b94c7a9-95f5-4e69-b487-28286211662e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:18:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Acquiring lock "cinder-quobyte-3b94c7a9-95f5-4e69-b487-28286211662e" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:18:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Lock "cinder-quobyte-3b94c7a9-95f5-4e69-b487-28286211662e" acquired by "delete_volume" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:18:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa37d22a-7c97-4a26-9119-a7e3b9f48de7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:18:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:31 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e Jul 05 17:18:31 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:32 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e" returned: 0 in 0.950s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:32 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e Jul 05 17:18:32 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:33 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3b94c7a9-95f5-4e69-b487-28286211662e" returned: 0 in 0.802s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Lock "cinder-quobyte-3b94c7a9-95f5-4e69-b487-28286211662e" released by "delete_volume" :: held 1.818s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Created reservations ['be5df8fe-fb13-42ef-81ce-bdd7eb0db455', '13f0bd4a-111f-4748-a3a6-247e0651fe89', 'd63fe38d-75b3-47ce-bb33-99f28314db1b', '7a2f40f7-98d7-4c1a-a11e-18e68835d842'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:18:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:33 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:18:33 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:34 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.749s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:34 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:18:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Deleted volume successfully. Jul 05 17:18:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-66090fa9-fd74-4ab3-82f1-98c06f729244 tempest-DeleteServersTestJSON-1942059729 None] Lock "cinder-3b94c7a9-95f5-4e69-b487-28286211662e-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:18:48 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:18:48 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:18:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:18:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:18:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:18:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:18:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:18:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:18:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:18:50 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:18:50 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:18:51 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Jul 05 17:18:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.044s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:18:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:18:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:18:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 8 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:18:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:19:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-47642931-b2c7-457b-ba9d-ab8f938dadd8 req-8e2bf307-1a58-4479-b88b-129d78eddb3c tempest-TaggedAttachmentsTest-590563988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-47642931-b2c7-457b-ba9d-ab8f938dadd8 req-8e2bf307-1a58-4479-b88b-129d78eddb3c tempest-TaggedAttachmentsTest-590563988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ab7e14-81ac-4611-a162-618854b927ef]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:19:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-47642931-b2c7-457b-ba9d-ab8f938dadd8 req-8e2bf307-1a58-4479-b88b-129d78eddb3c tempest-TaggedAttachmentsTest-590563988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:04 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac Jul 05 17:19:04 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:04 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-47642931-b2c7-457b-ba9d-ab8f938dadd8 req-8e2bf307-1a58-4479-b88b-129d78eddb3c tempest-TaggedAttachmentsTest-590563988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac" returned: 0 in 0.824s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-47642931-b2c7-457b-ba9d-ab8f938dadd8 req-8e2bf307-1a58-4479-b88b-129d78eddb3c tempest-TaggedAttachmentsTest-590563988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-47642931-b2c7-457b-ba9d-ab8f938dadd8 req-8e2bf307-1a58-4479-b88b-129d78eddb3c tempest-TaggedAttachmentsTest-590563988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ad4aa74-0b90-4acf-8fa1-19d8cebb83e6', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:19:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-47642931-b2c7-457b-ba9d-ab8f938dadd8 req-8e2bf307-1a58-4479-b88b-129d78eddb3c tempest-TaggedAttachmentsTest-590563988 None] attachment_update completed successfully. Jul 05 17:19:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-0ff33128-a478-4bfb-9d61-6da017fcfff1 req-c03fc630-afdf-4ac4-b260-1f104d50b5d4 tempest-TaggedAttachmentsTest-590563988 None] Terminate volume connection completed successfully. Jul 05 17:19:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-0ff33128-a478-4bfb-9d61-6da017fcfff1 req-c03fc630-afdf-4ac4-b260-1f104d50b5d4 tempest-TaggedAttachmentsTest-590563988 None] Deleting attachment 9ad4aa74-0b90-4acf-8fa1-19d8cebb83e6. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Flow 'volume_create_manager' (08e2cd0c-bed3-4a9d-9b97-fdfdd881f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d93f68-821a-443d-ae65-1a6b1d436a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d93f68-821a-443d-ae65-1a6b1d436a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1097717321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef64d43344214ea78fb567b949f2950e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:19:15Z,use_quota=True,user_id='79a634ff0fe5462f883ee13a274f3473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a6da2b-268e-4066-ba4a-2e3f9e8d61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a6da2b-268e-4066-ba4a-2e3f9e8d61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be47348-8898-4b00-9c36-36271ef5dd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be47348-8898-4b00-9c36-36271ef5dd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5', 'volume_name': 'volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a9bc79-4bcf-41f8-baf5-23dd6c34316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a9bc79-4bcf-41f8-baf5-23dd6c34316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f52cedb-6719-4ba8-8201-c58e3090f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:15 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Volume 0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5', 'volume_size': 1} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1097717321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef64d43344214ea78fb567b949f2950e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:19:15Z,use_quota=True,user_id='79a634ff0fe5462f883ee13a274f3473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Creating volume 0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:19:15 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:19:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:15 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 1073741824 Jul 05 17:19:15 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:16 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 1073741824" returned: 0 in 1.247s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:16 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 Jul 05 17:19:16 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:17 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5" returned: 0 in 1.129s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] <== create_volume: return (2426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:19:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f52cedb-6719-4ba8-8201-c58e3090f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3d844d-5b3a-4d93-8bab-fc5221cf94a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:17 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Volume volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 (0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5): created successfully Jul 05 17:19:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3d844d-5b3a-4d93-8bab-fc5221cf94a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Flow 'volume_create_manager' (08e2cd0c-bed3-4a9d-9b97-fdfdd881f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:19:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4f171d1a-410c-4eb1-aa20-5c48ec49e9f7 tempest-AttachVolumeShelveTestJSON-349803615 None] Created volume successfully. Jul 05 17:19:27 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:19:27 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:19:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Acquiring lock "cinder-ef0b0fd1-201a-4384-9f3d-7b48777f09ac-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:19:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Lock "cinder-ef0b0fd1-201a-4384-9f3d-7b48777f09ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:19:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Acquiring lock "cinder-quobyte-ef0b0fd1-201a-4384-9f3d-7b48777f09ac" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:19:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Lock "cinder-quobyte-ef0b0fd1-201a-4384-9f3d-7b48777f09ac" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:19:34 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b223496b-5666-4b95-b742-1db5299a9ea7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:19:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:34 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac Jul 05 17:19:34 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:35 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac" returned: 0 in 1.007s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:35 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac Jul 05 17:19:35 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:36 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ef0b0fd1-201a-4384-9f3d-7b48777f09ac" returned: 0 in 0.893s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Lock "cinder-quobyte-ef0b0fd1-201a-4384-9f3d-7b48777f09ac" released by "delete_volume" :: held 1.956s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Created reservations ['6bbc50bb-200c-41c4-8240-9892aa389a49', 'ea655c99-750a-43d2-b379-c2eacc0bc11c', '1e3f0446-2e6e-4bcf-a2b5-2454d22aeb37', '3ad80cba-88ac-4f16-9970-391f0fb15a29'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:36 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:19:36 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-7d861236-4246-455b-865c-4a8c79b4fb59 req-7c72968c-08ef-457e-ab7a-bad618d3fb36 tempest-AttachVolumeShelveTestJSON-349803615 None] No connector for attachment a3cdfdcd-78ff-417b-a882-e88a84877e8f; skipping storage backend terminate_connection call. {{(pid=86459) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 05 17:19:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-7d861236-4246-455b-865c-4a8c79b4fb59 req-7c72968c-08ef-457e-ab7a-bad618d3fb36 tempest-AttachVolumeShelveTestJSON-349803615 None] Deleting attachment a3cdfdcd-78ff-417b-a882-e88a84877e8f. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:19:37 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.699s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:37 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:19:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Deleted volume successfully. Jul 05 17:19:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0ffd9005-8951-4e8c-9e55-f3b5a21588ea tempest-TaggedAttachmentsTest-590563988 None] Lock "cinder-ef0b0fd1-201a-4384-9f3d-7b48777f09ac-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:19:38 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:19:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Flow 'volume_create_manager' (fdb3e658-e09d-4594-9b5c-7d26bc49dab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d533761e-1fdd-4371-b79e-54ee90689bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d533761e-1fdd-4371-b79e-54ee90689bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-397829913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bc44c6-94f4-4dee-bcab-710b2bb5fbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38bd690dfd746f1ba45f177424b39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:19:39Z,use_quota=True,user_id='bae804cf4440454daa26fc5e27ac184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7379a0-1f2f-4f93-87e1-ec9dd64da5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7379a0-1f2f-4f93-87e1-ec9dd64da5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa6570d-8636-4a0a-9759-3ae1a03dcd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa6570d-8636-4a0a-9759-3ae1a03dcd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bc44c6-94f4-4dee-bcab-710b2bb5fbad', 'volume_name': 'volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7e7f1e-17d5-4b9b-a403-94f898351307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7e7f1e-17d5-4b9b-a403-94f898351307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905431be-34d3-4d9c-980a-93bbcbff654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:39 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Volume 38bc44c6-94f4-4dee-bcab-710b2bb5fbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad', 'volume_size': 1} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-397829913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bc44c6-94f4-4dee-bcab-710b2bb5fbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38bd690dfd746f1ba45f177424b39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:19:39Z,use_quota=True,user_id='bae804cf4440454daa26fc5e27ac184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Creating volume 38bc44c6-94f4-4dee-bcab-710b2bb5fbad {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:19:39 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:19:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:39 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad 1073741824 Jul 05 17:19:39 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:40 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad 1073741824" returned: 0 in 1.388s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:40 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad Jul 05 17:19:40 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:41 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad" returned: 0 in 0.845s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:19:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905431be-34d3-4d9c-980a-93bbcbff654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515e1301-a347-4330-b609-40c582622ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:41 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Volume volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad (38bc44c6-94f4-4dee-bcab-710b2bb5fbad): created successfully Jul 05 17:19:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515e1301-a347-4330-b609-40c582622ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Flow 'volume_create_manager' (fdb3e658-e09d-4594-9b5c-7d26bc49dab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:19:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-68597217-99c3-453b-ad81-b191cad92025 tempest-ServerActionsTestOtherA-1899146110 None] Created volume successfully. Jul 05 17:19:45 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:19:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Flow 'volume_create_manager' (9414d4e7-a174-4b62-a4ae-b8db4c9abc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:19:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1642a4e-e7c5-43bc-8bcd-13258fc8e941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1642a4e-e7c5-43bc-8bcd-13258fc8e941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-330776435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd07893c-5066-48ac-89ce-760bf2c2d1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f593eed8a94eb9afa812743b74d6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:19:46Z,use_quota=True,user_id='edb86e021e3240bd8df5be6d05f45b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17316c42-0c28-474b-b869-10b5ef8ce7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17316c42-0c28-474b-b869-10b5ef8ce7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b125876e-fe91-4254-9a5c-296ab1854f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b125876e-fe91-4254-9a5c-296ab1854f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd07893c-5066-48ac-89ce-760bf2c2d1c1', 'volume_name': 'volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362ad926-2048-4ec7-86a7-298013fb572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362ad926-2048-4ec7-86a7-298013fb572e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8fb434-edb6-4f80-86a8-3169d007710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:46 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Volume fd07893c-5066-48ac-89ce-760bf2c2d1c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1', 'volume_size': 1} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-330776435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd07893c-5066-48ac-89ce-760bf2c2d1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f593eed8a94eb9afa812743b74d6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:19:46Z,use_quota=True,user_id='edb86e021e3240bd8df5be6d05f45b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Creating volume fd07893c-5066-48ac-89ce-760bf2c2d1c1 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:19:46 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:19:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:46 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 1073741824 Jul 05 17:19:46 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:47 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 1073741824" returned: 0 in 0.930s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:47 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 Jul 05 17:19:47 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:47 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1" returned: 0 in 0.717s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8fb434-edb6-4f80-86a8-3169d007710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae3405c-1256-431f-8e38-dadf1bae80f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:19:47 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Volume volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 (fd07893c-5066-48ac-89ce-760bf2c2d1c1): created successfully Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae3405c-1256-431f-8e38-dadf1bae80f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:19:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Flow 'volume_create_manager' (9414d4e7-a174-4b62-a4ae-b8db4c9abc05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:19:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fbe5815e-1ac1-45fe-aee4-61956126ead4 tempest-AttachVolumeTestJSON-1672913377 None] Created volume successfully. Jul 05 17:19:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:19:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:19:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:19:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:50 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:19:50 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-17f2511c-1c4b-4120-8b44-3051af715356 req-3a72170a-b42d-4bff-b031-72d0aae9e23f tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:19:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-17f2511c-1c4b-4120-8b44-3051af715356 req-3a72170a-b42d-4bff-b031-72d0aae9e23f tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:19:51 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d488436-bd84-44d8-9062-ad0fecf89f74]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:19:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-17f2511c-1c4b-4120-8b44-3051af715356 req-3a72170a-b42d-4bff-b031-72d0aae9e23f tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:19:51 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 Jul 05 17:19:51 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:19:51 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.188s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:19:52 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Jul 05 17:19:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-17f2511c-1c4b-4120-8b44-3051af715356 req-3a72170a-b42d-4bff-b031-72d0aae9e23f tempest-AttachVolumeTestJSON-1672913377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1" returned: 0 in 1.112s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:19:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-17f2511c-1c4b-4120-8b44-3051af715356 req-3a72170a-b42d-4bff-b031-72d0aae9e23f tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.162s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:19:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-17f2511c-1c4b-4120-8b44-3051af715356 req-3a72170a-b42d-4bff-b031-72d0aae9e23f tempest-AttachVolumeTestJSON-1672913377 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '679e5578-2309-44be-a308-d978c537116d', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:19:52 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-17f2511c-1c4b-4120-8b44-3051af715356 req-3a72170a-b42d-4bff-b031-72d0aae9e23f tempest-AttachVolumeTestJSON-1672913377 None] attachment_update completed successfully. Jul 05 17:20:02 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:20:02 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=18,cinder:INSERT=2,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:20:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-566374c4-c63f-4acc-a967-231964fb862a req-8eea87ec-39b2-4686-8dc4-3c546482972d tempest-ServerActionsTestOtherA-1899146110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:20:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-566374c4-c63f-4acc-a967-231964fb862a req-8eea87ec-39b2-4686-8dc4-3c546482972d tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:20:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cb4c54-f1a2-465f-8ddd-86b46eaf35ac]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:20:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-566374c4-c63f-4acc-a967-231964fb862a req-8eea87ec-39b2-4686-8dc4-3c546482972d tempest-ServerActionsTestOtherA-1899146110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:31 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad Jul 05 17:20:31 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:20:31 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Jul 05 17:20:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-566374c4-c63f-4acc-a967-231964fb862a req-8eea87ec-39b2-4686-8dc4-3c546482972d tempest-ServerActionsTestOtherA-1899146110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad" returned: 0 in 0.893s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:20:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-566374c4-c63f-4acc-a967-231964fb862a req-8eea87ec-39b2-4686-8dc4-3c546482972d tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:20:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-566374c4-c63f-4acc-a967-231964fb862a req-8eea87ec-39b2-4686-8dc4-3c546482972d tempest-ServerActionsTestOtherA-1899146110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6341c31-144b-4e1b-be23-be6110a7a711', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:20:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-566374c4-c63f-4acc-a967-231964fb862a req-8eea87ec-39b2-4686-8dc4-3c546482972d tempest-ServerActionsTestOtherA-1899146110 None] attachment_update completed successfully. Jul 05 17:20:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Acquiring lock "cinder-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:20:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "cinder-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:20:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Acquiring lock "cinder-quobyte-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:20:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "cinder-quobyte-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:20:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e2f93d-a963-4e6b-9d01-acce14380f88]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:20:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:35 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 Jul 05 17:20:35 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:20:36 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Jul 05 17:20:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5" returned: 0 in 0.797s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:20:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:36 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5 Jul 05 17:20:36 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:20:36 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Jul 05 17:20:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5" returned: 0 in 0.679s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:20:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "cinder-quobyte-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5" released by "delete_volume" :: held 1.518s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:20:36 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Created reservations ['b1572551-e3e2-4965-871d-5bc508a75186', '73f201ac-5ac4-4251-b700-0f3f788574f9', '39af6194-59c8-46aa-b181-0b44fb623ae2', 'd6b58f46-f055-4030-b8e4-1ea4aea13fca'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:20:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:20:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:20:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:20:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:20:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:20:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:37 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:20:37 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:20:37 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Jul 05 17:20:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.809s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:20:37 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:20:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Deleted volume successfully. Jul 05 17:20:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f2a25aa8-ef8b-4bed-9ce2-fd3e6c8bb723 tempest-AttachVolumeShelveTestJSON-349803615 None] Lock "cinder-0633edc5-ee3a-4579-b1ce-b94d2ee1c5c5-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:20:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-bcd23640-5cf4-47f8-934a-6662d4df5032 tempest-ServerActionsTestOtherA-1899146110 None] Terminate volume connection completed successfully. Jul 05 17:20:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-bcd23640-5cf4-47f8-934a-6662d4df5032 tempest-ServerActionsTestOtherA-1899146110 None] Deleting attachment f6341c31-144b-4e1b-be23-be6110a7a711. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:20:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-9feb1b1e-e795-442d-bf3c-69fc08a047ac tempest-ServerActionsTestOtherA-1899146110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:20:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-9feb1b1e-e795-442d-bf3c-69fc08a047ac tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:20:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a3c4a3-f097-44e2-8f2a-7b6de5b2021e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:20:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-aa35aa09-af94-41c0-ac8f-2a40629fb7f4 req-cd49bf64-0403-47a1-9857-7d17b95ecf71 tempest-AttachVolumeTestJSON-1672913377 None] Terminate volume connection completed successfully. Jul 05 17:20:44 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-aa35aa09-af94-41c0-ac8f-2a40629fb7f4 req-cd49bf64-0403-47a1-9857-7d17b95ecf71 tempest-AttachVolumeTestJSON-1672913377 None] Deleting attachment 679e5578-2309-44be-a308-d978c537116d. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:20:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-9feb1b1e-e795-442d-bf3c-69fc08a047ac tempest-ServerActionsTestOtherA-1899146110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:44 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad Jul 05 17:20:44 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:20:46 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Jul 05 17:20:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-9feb1b1e-e795-442d-bf3c-69fc08a047ac tempest-ServerActionsTestOtherA-1899146110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad" returned: 0 in 1.655s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:20:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-9feb1b1e-e795-442d-bf3c-69fc08a047ac tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.725s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:20:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-9feb1b1e-e795-442d-bf3c-69fc08a047ac tempest-ServerActionsTestOtherA-1899146110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9faff007-6092-49d7-920c-883d28795a99', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:20:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-5b99f982-0470-48ff-952d-7ff229ea1568 req-9feb1b1e-e795-442d-bf3c-69fc08a047ac tempest-ServerActionsTestOtherA-1899146110 None] attachment_update completed successfully. Jul 05 17:20:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:20:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:20:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:20:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:20:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:20:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:20:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:50 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:20:50 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:20:51 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Jul 05 17:20:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.726s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:20:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:20:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:20:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 8 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:20:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Flow 'volume_create_manager' (eb6f180f-bd7f-40c1-97d4-99e595be1cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832d76d1-025c-4548-bbe2-963fd646985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832d76d1-025c-4548-bbe2-963fd646985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-387404771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3419805f-bcb4-4bdd-b8c0-1717f577e52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d3f3c312b44abb8f07f44387bad9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:20:55Z,use_quota=True,user_id='ecf042f2624848479e2f8dd14d3f97dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272d4778-66fe-4008-9cc3-fc32fca8dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272d4778-66fe-4008-9cc3-fc32fca8dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b474e3b-a3a6-473e-850d-d39cd4ea2d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b474e3b-a3a6-473e-850d-d39cd4ea2d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3419805f-bcb4-4bdd-b8c0-1717f577e52b', 'volume_name': 'volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf483735-22d3-4934-ac53-c2ff59b37680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf483735-22d3-4934-ac53-c2ff59b37680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016bd395-4ed3-4d4c-8ee6-722a2f84a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:20:54 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Volume 3419805f-bcb4-4bdd-b8c0-1717f577e52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b', 'volume_size': 1} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-387404771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3419805f-bcb4-4bdd-b8c0-1717f577e52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d3f3c312b44abb8f07f44387bad9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:20:55Z,use_quota=True,user_id='ecf042f2624848479e2f8dd14d3f97dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Creating volume 3419805f-bcb4-4bdd-b8c0-1717f577e52b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:20:54 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:20:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:54 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b 1073741824 Jul 05 17:20:54 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:20:56 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Jul 05 17:20:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b 1073741824" returned: 0 in 1.156s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:20:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:56 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b Jul 05 17:20:56 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:20:56 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e71d45a7-e98e-4c85-b498-52bbc5f17cd7 tempest-GroupsV320Test-184141233 None] Group tempest-GroupsV320Test-Group-974081770: creating Jul 05 17:20:56 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e71d45a7-e98e-4c85-b498-52bbc5f17cd7 tempest-GroupsV320Test-184141233 None] Group tempest-GroupsV320Test-Group-974081770: created successfully Jul 05 17:20:56 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e71d45a7-e98e-4c85-b498-52bbc5f17cd7 tempest-GroupsV320Test-184141233 None] Create group completed successfully. Jul 05 17:20:57 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Jul 05 17:20:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b" returned: 0 in 0.908s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:20:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:20:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:20:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016bd395-4ed3-4d4c-8ee6-722a2f84a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:20:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea72740-4620-412c-a6d7-6be686037ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:20:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Volume volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b (3419805f-bcb4-4bdd-b8c0-1717f577e52b): created successfully Jul 05 17:20:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea72740-4620-412c-a6d7-6be686037ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:20:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Flow 'volume_create_manager' (eb6f180f-bd7f-40c1-97d4-99e595be1cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:20:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-001225f7-3603-4e7c-bc4d-0bc6781188a4 tempest-ServersNegativeTestJSON-1685985414 None] Created volume successfully. Jul 05 17:20:59 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Created reservations ['f7283f95-cfb7-4d32-b71a-16e23a1eca9b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:20:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:20:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:20:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:20:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:20:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:20:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:20:59 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:20:59 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:00 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.891s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:21:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b207df2b-bf88-4d35-a565-bacb0bfc490c tempest-GroupsV320Test-184141233 None] Delete group completed successfully. Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Flow 'volume_create_manager' (845ce1f4-d9d2-47db-9895-66a92d803763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca652e8-0b40-4a51-8f06-03431ae3626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca652e8-0b40-4a51-8f06-03431ae3626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-909413388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8000f70-8612-4674-b77d-3d8347420ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d3f3c312b44abb8f07f44387bad9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:21:00Z,use_quota=True,user_id='ecf042f2624848479e2f8dd14d3f97dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eaa177b-1ace-40f0-9fea-b8e38c54ae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eaa177b-1ace-40f0-9fea-b8e38c54ae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc93b7d1-bdc9-4818-b763-1a0cb7d71b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc93b7d1-bdc9-4818-b763-1a0cb7d71b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8000f70-8612-4674-b77d-3d8347420ba9', 'volume_name': 'volume-f8000f70-8612-4674-b77d-3d8347420ba9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f43271-5112-40fb-8f34-6351cee9d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f43271-5112-40fb-8f34-6351cee9d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14de5c5-fcdb-4081-92ce-57236a924515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:00 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Volume f8000f70-8612-4674-b77d-3d8347420ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8000f70-8612-4674-b77d-3d8347420ba9', 'volume_size': 1} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-909413388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8000f70-8612-4674-b77d-3d8347420ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12d3f3c312b44abb8f07f44387bad9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:21:00Z,use_quota=True,user_id='ecf042f2624848479e2f8dd14d3f97dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Creating volume f8000f70-8612-4674-b77d-3d8347420ba9 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:21:00 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:21:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:00 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 1073741824 Jul 05 17:21:00 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:01 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 1073741824" returned: 0 in 1.344s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:01 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 Jul 05 17:21:01 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:02 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9" returned: 0 in 0.998s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] <== create_volume: return (2429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:21:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14de5c5-fcdb-4081-92ce-57236a924515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8000f70-8612-4674-b77d-3d8347420ba9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dae710-0616-4abd-8314-9d3f66ae3e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:02 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Volume volume-f8000f70-8612-4674-b77d-3d8347420ba9 (f8000f70-8612-4674-b77d-3d8347420ba9): created successfully Jul 05 17:21:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dae710-0616-4abd-8314-9d3f66ae3e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Flow 'volume_create_manager' (845ce1f4-d9d2-47db-9895-66a92d803763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:21:03 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b451b6f1-c6cf-47fd-8f57-c546ee366e4a tempest-ServersNegativeTestJSON-1685985414 None] Created volume successfully. Jul 05 17:21:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "cinder-f8000f70-8612-4674-b77d-3d8347420ba9-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Lock "cinder-f8000f70-8612-4674-b77d-3d8347420ba9-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "cinder-quobyte-f8000f70-8612-4674-b77d-3d8347420ba9" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Lock "cinder-quobyte-f8000f70-8612-4674-b77d-3d8347420ba9" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee30248c-d57a-4fc1-96fc-ca6891becc1d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:21:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:04 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 Jul 05 17:21:04 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:05 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9" returned: 0 in 0.931s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:05 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9 Jul 05 17:21:05 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:06 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8000f70-8612-4674-b77d-3d8347420ba9" returned: 0 in 0.925s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Lock "cinder-quobyte-f8000f70-8612-4674-b77d-3d8347420ba9" released by "delete_volume" :: held 1.905s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Created reservations ['76636496-d8ca-4ac3-ba43-6ec16a5f1bca', 'a1f1facf-e591-401f-b7bc-b9a40ad315c4', 'ca683753-5426-4d5c-8f08-bab9a773db18', '113e5ee7-9337-4832-ae6a-7499cd6b2d56'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:06 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:21:06 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "cinder-3419805f-bcb4-4bdd-b8c0-1717f577e52b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Lock "cinder-3419805f-bcb4-4bdd-b8c0-1717f577e52b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "cinder-quobyte-3419805f-bcb4-4bdd-b8c0-1717f577e52b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Lock "cinder-quobyte-3419805f-bcb4-4bdd-b8c0-1717f577e52b" acquired by "delete_volume" :: waited 0.048s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:07 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e6ef6b-2973-479e-8ab6-17bead9d3e69]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:21:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:07 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b Jul 05 17:21:07 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:07 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.999s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:07 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:21:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Deleted volume successfully. Jul 05 17:21:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-913e60d3-34f9-4ce5-99d7-bae9d92826bf tempest-ServersNegativeTestJSON-1685985414 None] Lock "cinder-f8000f70-8612-4674-b77d-3d8347420ba9-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:08 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b" returned: 0 in 1.236s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:08 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b Jul 05 17:21:08 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:08 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3419805f-bcb4-4bdd-b8c0-1717f577e52b" returned: 0 in 0.641s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Lock "cinder-quobyte-3419805f-bcb4-4bdd-b8c0-1717f577e52b" released by "delete_volume" :: held 1.947s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:09 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Created reservations ['2f8e5156-d914-4b83-adea-9557f87bfac5', '70988754-d573-4d0e-a897-b32c9ced3be1', 'a0d6df3e-6951-4e38-85b2-bd0c431edc58', '7f60fddf-61b6-4d22-93d2-e9e4f5445b8a'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:21:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:09 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:21:09 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:10 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.039s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:10 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:21:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Deleted volume successfully. Jul 05 17:21:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b20ea04-2712-4d21-a701-911626c0c6cd tempest-ServersNegativeTestJSON-1685985414 None] Lock "cinder-3419805f-bcb4-4bdd-b8c0-1717f577e52b-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:18 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-c54fd503-5824-40c6-8b6c-2ff481865901 req-f3209920-4722-4730-9c8a-987cd6fadfbe tempest-ServerActionsTestOtherA-1899146110 None] Terminate volume connection completed successfully. Jul 05 17:21:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-c54fd503-5824-40c6-8b6c-2ff481865901 req-f3209920-4722-4730-9c8a-987cd6fadfbe tempest-ServerActionsTestOtherA-1899146110 None] Deleting attachment 9faff007-6092-49d7-920c-883d28795a99. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:21:26 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=39,cinder:UPDATE=44,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=42,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Flow 'volume_create_manager' (79f1b346-626d-42ff-b3c5-be808a3aa820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98b8f65-74c1-40ad-882f-34bd6ac55f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98b8f65-74c1-40ad-882f-34bd6ac55f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-831624368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d27754-9c19-428e-9c79-d62aba9ec9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc74f43cbf9c487db9275ee72b8c8e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:21:27Z,use_quota=True,user_id='df3477159e924bbea14e4062de6f8070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df974061-3d10-46fd-ad82-fd66f38888e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df974061-3d10-46fd-ad82-fd66f38888e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752964e6-3f67-4ebc-b2db-2ae98202ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752964e6-3f67-4ebc-b2db-2ae98202ff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d27754-9c19-428e-9c79-d62aba9ec9cb', 'volume_name': 'volume-27d27754-9c19-428e-9c79-d62aba9ec9cb', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d752ca-ea19-4464-ae31-edf3fa2c20c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d752ca-ea19-4464-ae31-edf3fa2c20c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98233d5-beab-45ca-b11b-0f8170e2472e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:27 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Volume 27d27754-9c19-428e-9c79-d62aba9ec9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d27754-9c19-428e-9c79-d62aba9ec9cb', 'volume_size': 1} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-831624368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d27754-9c19-428e-9c79-d62aba9ec9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc74f43cbf9c487db9275ee72b8c8e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:21:27Z,use_quota=True,user_id='df3477159e924bbea14e4062de6f8070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Creating volume 27d27754-9c19-428e-9c79-d62aba9ec9cb {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:21:27 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:21:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:27 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb 1073741824 Jul 05 17:21:27 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:28 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb 1073741824" returned: 0 in 0.953s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:28 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb Jul 05 17:21:28 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:28 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb" returned: 0 in 0.652s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98233d5-beab-45ca-b11b-0f8170e2472e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d27754-9c19-428e-9c79-d62aba9ec9cb', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3617704f-c3cb-47ab-bc2d-55ea8eb1d272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:28 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Volume volume-27d27754-9c19-428e-9c79-d62aba9ec9cb (27d27754-9c19-428e-9c79-d62aba9ec9cb): created successfully Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3617704f-c3cb-47ab-bc2d-55ea8eb1d272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Flow 'volume_create_manager' (79f1b346-626d-42ff-b3c5-be808a3aa820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:21:28 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c8b9d210-c632-42fd-9c66-039c28c74690 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Created volume successfully. Jul 05 17:21:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Acquiring lock "cinder-27d27754-9c19-428e-9c79-d62aba9ec9cb-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "cinder-27d27754-9c19-428e-9c79-d62aba9ec9cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Acquiring lock "cinder-quobyte-27d27754-9c19-428e-9c79-d62aba9ec9cb" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "cinder-quobyte-27d27754-9c19-428e-9c79-d62aba9ec9cb" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[27929cf4-d8c6-48ed-a9b5-b22e1fbf95a8]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:21:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:29 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb Jul 05 17:21:29 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Acquiring lock "cinder-38bc44c6-94f4-4dee-bcab-710b2bb5fbad-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Lock "cinder-38bc44c6-94f4-4dee-bcab-710b2bb5fbad-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Acquiring lock "cinder-quobyte-38bc44c6-94f4-4dee-bcab-710b2bb5fbad" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Lock "cinder-quobyte-38bc44c6-94f4-4dee-bcab-710b2bb5fbad" acquired by "delete_volume" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:30 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[82196a9e-2677-4e09-b635-e81bd734d0c4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:21:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:30 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb" returned: 0 in 1.148s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:30 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb Jul 05 17:21:30 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:30 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad Jul 05 17:21:30 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:31 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-27d27754-9c19-428e-9c79-d62aba9ec9cb" returned: 0 in 0.828s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "cinder-quobyte-27d27754-9c19-428e-9c79-d62aba9ec9cb" released by "delete_volume" :: held 2.054s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Created reservations ['285dd32f-d1ab-4f24-911e-f9c7499ffc1a', 'c1d1e421-994d-46e7-9fda-e514a969e955', 'f9b42369-026b-437e-8f45-d4935ada5624', '5d7ca934-4418-439d-be76-8c03f19ca31d'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:31 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:21:31 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:31 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad" returned: 0 in 1.213s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:31 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad Jul 05 17:21:31 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Flow 'volume_create_manager' (649fe30e-ac8d-4a04-99d3-1c1e66532094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47b2a88-196f-432a-9537-848022fa30ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47b2a88-196f-432a-9537-848022fa30ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-313510855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70de6e82-3c31-426b-9c54-a40170cf05cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc74f43cbf9c487db9275ee72b8c8e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:21:32Z,use_quota=True,user_id='df3477159e924bbea14e4062de6f8070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8de556e-0ff3-4d88-ad53-0a035c04ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8de556e-0ff3-4d88-ad53-0a035c04ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dba517f-dfb0-41c9-b118-020a134b17d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dba517f-dfb0-41c9-b118-020a134b17d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70de6e82-3c31-426b-9c54-a40170cf05cd', 'volume_name': 'volume-70de6e82-3c31-426b-9c54-a40170cf05cd', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61789795-2c96-4693-b03f-9e18cd12d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61789795-2c96-4693-b03f-9e18cd12d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b6bc84-4214-42bc-b8c5-4cdb50febaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:32 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Volume 70de6e82-3c31-426b-9c54-a40170cf05cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70de6e82-3c31-426b-9c54-a40170cf05cd', 'volume_size': 1} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-313510855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70de6e82-3c31-426b-9c54-a40170cf05cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc74f43cbf9c487db9275ee72b8c8e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:21:32Z,use_quota=True,user_id='df3477159e924bbea14e4062de6f8070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Creating volume 70de6e82-3c31-426b-9c54-a40170cf05cd {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:21:32 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:32 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd 1073741824 Jul 05 17:21:32 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:32 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.238s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:32 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-38bc44c6-94f4-4dee-bcab-710b2bb5fbad" returned: 0 in 1.090s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Deleted volume successfully. Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Lock "cinder-quobyte-38bc44c6-94f4-4dee-bcab-710b2bb5fbad" released by "delete_volume" :: held 2.419s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2a7333f8-72eb-4852-80d5-1dd8c4e29052 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "cinder-27d27754-9c19-428e-9c79-d62aba9ec9cb-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:32 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Created reservations ['28e0c9e3-41ec-43ed-9309-0e92cbe838ce', '2e9d1c2e-bb12-423a-9e9c-96a4b3de3105', '01811959-579e-4ffe-9a73-75f5b6a79d12', 'f245362e-f008-43eb-af31-7416e875b1c7'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:21:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:33 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:21:33 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:34 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.015s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:34 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:21:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Deleted volume successfully. Jul 05 17:21:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64577d14-f383-4ecc-95f6-21043e104212 tempest-ServerActionsTestOtherA-1899146110 None] Lock "cinder-38bc44c6-94f4-4dee-bcab-710b2bb5fbad-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:34 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd 1073741824" returned: 0 in 1.381s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:34 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd Jul 05 17:21:34 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:35 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd" returned: 0 in 0.880s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:21:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.327s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b6bc84-4214-42bc-b8c5-4cdb50febaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70de6e82-3c31-426b-9c54-a40170cf05cd', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04f9cf2-e4b5-4897-a0be-f225fc6ca7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:21:35 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Volume volume-70de6e82-3c31-426b-9c54-a40170cf05cd (70de6e82-3c31-426b-9c54-a40170cf05cd): created successfully Jul 05 17:21:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04f9cf2-e4b5-4897-a0be-f225fc6ca7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:21:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Flow 'volume_create_manager' (649fe30e-ac8d-4a04-99d3-1c1e66532094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:21:35 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-92329c41-c400-445d-bc47-a17f6ab8ed10 tempest-VolumeQuotasAdminTestJSON-2033738308 None] Created volume successfully. Jul 05 17:21:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e9df576c-7cd0-4d56-8a09-56ac738ab4cb tempest-VolumeQuotasAdminTestJSON-1793407473 None] Transfer volume completed successfully. Jul 05 17:21:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Acquiring lock "cinder-70de6e82-3c31-426b-9c54-a40170cf05cd-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Lock "cinder-70de6e82-3c31-426b-9c54-a40170cf05cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Acquiring lock "cinder-quobyte-70de6e82-3c31-426b-9c54-a40170cf05cd" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:21:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Lock "cinder-quobyte-70de6e82-3c31-426b-9c54-a40170cf05cd" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:21:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d197b817-664b-4951-8aec-ee267837a606]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:21:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:38 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd Jul 05 17:21:38 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:38 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd" returned: 0 in 0.914s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:38 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd Jul 05 17:21:38 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:39 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-70de6e82-3c31-426b-9c54-a40170cf05cd" returned: 0 in 0.698s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Lock "cinder-quobyte-70de6e82-3c31-426b-9c54-a40170cf05cd" released by "delete_volume" :: held 1.648s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Created reservations ['ae7b4d2f-4635-44af-9e33-131cafbf1af9', '711ed0b6-50d3-4c6e-8e9d-8773b8952f86', 'b56f4c0b-2de3-46c1-8678-6ce3f6ca78da', '4d533c68-995a-4131-ba8c-696347229d76'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:39 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:21:39 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:40 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.810s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:40 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:21:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Deleted volume successfully. Jul 05 17:21:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-65c9830e-56b3-4f29-ae42-d019580cdb8b tempest-VolumeQuotasAdminTestJSON-610981097 None] Lock "cinder-70de6e82-3c31-426b-9c54-a40170cf05cd-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:21:49 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=34,cinder:SELECT=19,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:21:50 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=19,cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:21:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:21:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:21:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:21:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:21:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:21:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:21:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:21:50 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:21:50 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:21:51 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Jul 05 17:21:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.876s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:21:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:21:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:21:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 8 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:21:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Flow 'volume_create_manager' (16bcad4a-3b15-4c9f-ac15-2b5206e249ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee31a8a-df16-4639-b546-66fddb4cc83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee31a8a-df16-4639-b546-66fddb4cc83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1615739484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87673b03-3c9a-49a7-9e7b-e949b87fdf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4be2de3ccf4aa1a26b1a040024d62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:02Z,use_quota=True,user_id='4274f5228d724be7a6386258dd6dbdfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb1f773-aff3-482a-a8dd-2f6743ca3604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb1f773-aff3-482a-a8dd-2f6743ca3604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2950402f-ab8c-4e56-b97f-85ed154812a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2950402f-ab8c-4e56-b97f-85ed154812a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87673b03-3c9a-49a7-9e7b-e949b87fdf4b', 'volume_name': 'volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed398497-8af9-4875-bdaf-2bbc50aa0165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed398497-8af9-4875-bdaf-2bbc50aa0165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c3bda2-766d-4374-ba76-645e7995f783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:02 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Volume 87673b03-3c9a-49a7-9e7b-e949b87fdf4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b', 'volume_size': 1} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1615739484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87673b03-3c9a-49a7-9e7b-e949b87fdf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4be2de3ccf4aa1a26b1a040024d62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:02Z,use_quota=True,user_id='4274f5228d724be7a6386258dd6dbdfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Creating volume 87673b03-3c9a-49a7-9e7b-e949b87fdf4b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:22:02 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:22:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:02 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b 1073741824 Jul 05 17:22:02 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:03 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b 1073741824" returned: 0 in 1.321s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:03 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b Jul 05 17:22:03 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:05 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b" returned: 0 in 1.533s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] <== create_volume: return (2939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:22:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.944s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c3bda2-766d-4374-ba76-645e7995f783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4e2820-760b-4bf2-afd4-dc3437dc63b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:05 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Volume volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b (87673b03-3c9a-49a7-9e7b-e949b87fdf4b): created successfully Jul 05 17:22:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4e2820-760b-4bf2-afd4-dc3437dc63b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Flow 'volume_create_manager' (16bcad4a-3b15-4c9f-ac15-2b5206e249ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-befbc7e6-466e-451b-8ba0-b62feff86cdc tempest-VolumesMetadataTest-1311897519 None] Created volume successfully. Jul 05 17:22:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Acquiring lock "cinder-87673b03-3c9a-49a7-9e7b-e949b87fdf4b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:22:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Lock "cinder-87673b03-3c9a-49a7-9e7b-e949b87fdf4b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:22:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Acquiring lock "cinder-quobyte-87673b03-3c9a-49a7-9e7b-e949b87fdf4b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:22:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Lock "cinder-quobyte-87673b03-3c9a-49a7-9e7b-e949b87fdf4b" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:22:07 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee0b14e-e780-40d3-b745-4abf58322c6d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:22:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:08 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b Jul 05 17:22:08 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:08 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b" returned: 0 in 1.089s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:08 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b Jul 05 17:22:08 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:09 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87673b03-3c9a-49a7-9e7b-e949b87fdf4b" returned: 0 in 0.725s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Lock "cinder-quobyte-87673b03-3c9a-49a7-9e7b-e949b87fdf4b" released by "delete_volume" :: held 1.861s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Created reservations ['7a10584f-0583-437c-824e-07d4595926b9', 'c9c18223-d2a6-4e41-8cd2-9e75a789556c', 'bdf07609-6ab3-40ad-9ad3-3e9815fc16ed', 'af061c52-5519-423d-9168-9d42d74cdc48'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:09 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:22:09 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:10 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.677s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:10 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:22:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Deleted volume successfully. Jul 05 17:22:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4449f118-53e4-4baa-bc9f-c744ba642e39 tempest-VolumesMetadataTest-1311897519 None] Lock "cinder-87673b03-3c9a-49a7-9e7b-e949b87fdf4b-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Flow 'volume_create_manager' (f2a8b71a-43d3-4831-905d-668793639177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07998719-a9c6-4144-8b2f-c2f7e1087b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07998719-a9c6-4144-8b2f-c2f7e1087b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1906433608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5cd660-f5d6-4df5-8fff-8cafdcc2e428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8216a121312146aa927a9a960a5f96a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:15Z,use_quota=True,user_id='616aa339918e431cbb8d93761e000ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee831b8-4cc5-4cfb-a164-960a1b9a0593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee831b8-4cc5-4cfb-a164-960a1b9a0593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959c4460-ea49-45d9-8086-8614fdd1ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959c4460-ea49-45d9-8086-8614fdd1ebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5cd660-f5d6-4df5-8fff-8cafdcc2e428', 'volume_name': 'volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66bb92c-5e3f-4b3a-ac48-b4fb54f8cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66bb92c-5e3f-4b3a-ac48-b4fb54f8cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476bac07-b3da-45c0-ace6-bf1496409309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:15 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Volume da5cd660-f5d6-4df5-8fff-8cafdcc2e428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428', 'volume_size': 1} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1906433608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5cd660-f5d6-4df5-8fff-8cafdcc2e428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8216a121312146aa927a9a960a5f96a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:15Z,use_quota=True,user_id='616aa339918e431cbb8d93761e000ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Creating volume da5cd660-f5d6-4df5-8fff-8cafdcc2e428 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:22:15 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:22:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:15 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 1073741824 Jul 05 17:22:15 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:16 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 1073741824" returned: 0 in 0.797s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:16 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 Jul 05 17:22:16 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:16 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428" returned: 0 in 0.661s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:22:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476bac07-b3da-45c0-ace6-bf1496409309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c787adf-63d5-4287-9dde-bfa978f3fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:17 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Volume volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 (da5cd660-f5d6-4df5-8fff-8cafdcc2e428): created successfully Jul 05 17:22:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c787adf-63d5-4287-9dde-bfa978f3fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Flow 'volume_create_manager' (f2a8b71a-43d3-4831-905d-668793639177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-55b874ae-4345-4938-a4b3-7cc8df64d596 tempest-VolumesTransfersV355Test-72556081 None] Created volume successfully. Jul 05 17:22:17 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:22:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Flow 'volume_create_manager' (fc1b4a20-1c32-48e2-a991-0610c9b0fe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b428c274-4a91-478a-bc24-79a385b20082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b428c274-4a91-478a-bc24-79a385b20082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-481834263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48577203-d7b2-4dad-82fa-ae57cb1ff884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f593eed8a94eb9afa812743b74d6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:18Z,use_quota=True,user_id='edb86e021e3240bd8df5be6d05f45b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b30286-6704-481d-8180-449456019963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b30286-6704-481d-8180-449456019963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245bbb36-9b91-46db-b1d8-92372f8ba0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245bbb36-9b91-46db-b1d8-92372f8ba0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48577203-d7b2-4dad-82fa-ae57cb1ff884', 'volume_name': 'volume-48577203-d7b2-4dad-82fa-ae57cb1ff884', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c36079-7a22-4b51-b29b-2212b163aaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c36079-7a22-4b51-b29b-2212b163aaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b9b22a-0092-4d48-afc9-3fbea4eb5894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:18 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Volume 48577203-d7b2-4dad-82fa-ae57cb1ff884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48577203-d7b2-4dad-82fa-ae57cb1ff884', 'volume_size': 1} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-481834263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48577203-d7b2-4dad-82fa-ae57cb1ff884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f593eed8a94eb9afa812743b74d6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:18Z,use_quota=True,user_id='edb86e021e3240bd8df5be6d05f45b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Creating volume 48577203-d7b2-4dad-82fa-ae57cb1ff884 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:22:18 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:22:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:18 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 1073741824 Jul 05 17:22:18 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:18 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-36a25b26-a9c6-4076-a2e9-6aa602bcc1d5 tempest-VolumesTransfersV355Test-615192608 None] Transfer volume completed successfully. Jul 05 17:22:19 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 1073741824" returned: 0 in 1.127s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:19 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 Jul 05 17:22:19 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Acquiring lock "cinder-da5cd660-f5d6-4df5-8fff-8cafdcc2e428-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Lock "cinder-da5cd660-f5d6-4df5-8fff-8cafdcc2e428-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:22:20 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884" returned: 0 in 1.152s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] <== create_volume: return (2368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.371s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Acquiring lock "cinder-quobyte-da5cd660-f5d6-4df5-8fff-8cafdcc2e428" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b9b22a-0092-4d48-afc9-3fbea4eb5894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48577203-d7b2-4dad-82fa-ae57cb1ff884', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931d9cea-8837-4f9c-992e-6d3301ad7c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Lock "cinder-quobyte-da5cd660-f5d6-4df5-8fff-8cafdcc2e428" acquired by "delete_volume" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:22:20 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Volume volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 (48577203-d7b2-4dad-82fa-ae57cb1ff884): created successfully Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931d9cea-8837-4f9c-992e-6d3301ad7c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Flow 'volume_create_manager' (fc1b4a20-1c32-48e2-a991-0610c9b0fe56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[681a2da8-5c0e-4135-9c56-04ee27cec48a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:22:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3ff8dd9d-891a-4896-8ac4-7d4a5a902f44 tempest-AttachVolumeTestJSON-1672913377 None] Created volume successfully. Jul 05 17:22:20 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 Jul 05 17:22:20 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:21 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428" returned: 0 in 0.884s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:21 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428 Jul 05 17:22:21 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:22 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da5cd660-f5d6-4df5-8fff-8cafdcc2e428" returned: 0 in 0.785s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Lock "cinder-quobyte-da5cd660-f5d6-4df5-8fff-8cafdcc2e428" released by "delete_volume" :: held 1.720s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Created reservations ['35fef8c1-8d7a-4ad0-bacf-9cc78436aaf0', '5e93f076-de86-4347-8507-65fcfef247f6', 'cd291704-0f87-4e61-8d92-086e2bfc069f', 'f83cdf68-d5fa-416c-8db6-13abd8739a70'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:22 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:22:22 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Flow 'volume_create_manager' (8aa757c8-a1e8-4e5f-aef5-74c43a821a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc563300-77a4-41a1-b37d-1855bb61e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc563300-77a4-41a1-b37d-1855bb61e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-758714582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bf26a9-8f69-4f90-b65e-edc126629074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34995594e2a48eb912a0b36b0988862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:23Z,use_quota=True,user_id='b1bfd72a1ff14564a1c1160962f57dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17356dd-7968-44ca-91db-1de64d6e0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17356dd-7968-44ca-91db-1de64d6e0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed7afdd-1036-43c1-b983-621b7204a785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed7afdd-1036-43c1-b983-621b7204a785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9bf26a9-8f69-4f90-b65e-edc126629074', 'volume_name': 'volume-f9bf26a9-8f69-4f90-b65e-edc126629074', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3352887-7fe6-42d3-a232-bacf9357dc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3352887-7fe6-42d3-a232-bacf9357dc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3c6900-f1ab-496c-b5a2-381521ac9fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Volume f9bf26a9-8f69-4f90-b65e-edc126629074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9bf26a9-8f69-4f90-b65e-edc126629074', 'volume_size': 1} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-758714582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bf26a9-8f69-4f90-b65e-edc126629074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34995594e2a48eb912a0b36b0988862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:23Z,use_quota=True,user_id='b1bfd72a1ff14564a1c1160962f57dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Creating volume f9bf26a9-8f69-4f90-b65e-edc126629074 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:22:23 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:23 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 1073741824 Jul 05 17:22:23 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:23 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.847s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:22:23 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Deleted volume successfully. Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a6baca1b-0c6c-4353-8690-5564819eb040 tempest-VolumesTransfersV355Test-1876682167 None] Lock "cinder-da5cd660-f5d6-4df5-8fff-8cafdcc2e428-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Flow 'volume_create_manager' (5a244e30-f1ec-4f34-bd36-861d8730a162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5f8608-a03a-4010-b3c6-bd5581ee58e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5f8608-a03a-4010-b3c6-bd5581ee58e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-891250934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55014c5-e4b8-4028-a709-397b1888d24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8216a121312146aa927a9a960a5f96a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:23Z,use_quota=True,user_id='616aa339918e431cbb8d93761e000ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662359a1-e18b-4ac4-a0b9-73eb63c64160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662359a1-e18b-4ac4-a0b9-73eb63c64160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805fbbfd-6494-438e-ad23-12016446583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805fbbfd-6494-438e-ad23-12016446583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c55014c5-e4b8-4028-a709-397b1888d24d', 'volume_name': 'volume-c55014c5-e4b8-4028-a709-397b1888d24d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3730aff-5d65-4475-aa0d-88fc4bb0f3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3730aff-5d65-4475-aa0d-88fc4bb0f3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40492759-3baa-4a96-bd6a-93f7af23a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:23 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Volume c55014c5-e4b8-4028-a709-397b1888d24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c55014c5-e4b8-4028-a709-397b1888d24d', 'volume_size': 1} Jul 05 17:22:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:24 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 1073741824" returned: 0 in 1.144s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:24 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 Jul 05 17:22:24 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-7e571d62-4c17-4616-9b78-00b6ae71db9f req-72f63798-53a7-429e-9e20-ba4c7ab6048b tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:25 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074" returned: 0 in 0.888s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-891250934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55014c5-e4b8-4028-a709-397b1888d24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8216a121312146aa927a9a960a5f96a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:23Z,use_quota=True,user_id='616aa339918e431cbb8d93761e000ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Creating volume c55014c5-e4b8-4028-a709-397b1888d24d {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:22:25 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:25 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d 1073741824 Jul 05 17:22:25 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3c6900-f1ab-496c-b5a2-381521ac9fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9bf26a9-8f69-4f90-b65e-edc126629074', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ed52e7-c0cc-410b-9fa3-88920e43ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:25 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Volume volume-f9bf26a9-8f69-4f90-b65e-edc126629074 (f9bf26a9-8f69-4f90-b65e-edc126629074): created successfully Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ed52e7-c0cc-410b-9fa3-88920e43ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Flow 'volume_create_manager' (8aa757c8-a1e8-4e5f-aef5-74c43a821a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-71841316-6862-4743-85a8-53d25453a9f3 tempest-AttachVolumeNegativeTest-1919246832 None] Created volume successfully. Jul 05 17:22:26 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d 1073741824" returned: 0 in 1.238s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:26 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d Jul 05 17:22:26 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:27 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-7e571d62-4c17-4616-9b78-00b6ae71db9f req-72f63798-53a7-429e-9e20-ba4c7ab6048b tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.545s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40492759-3baa-4a96-bd6a-93f7af23a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c55014c5-e4b8-4028-a709-397b1888d24d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb20565-4d71-4e2e-a18c-03d456dff288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc6af1b-fb9a-4f49-a5e9-3f580a9a24f0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-7e571d62-4c17-4616-9b78-00b6ae71db9f req-72f63798-53a7-429e-9e20-ba4c7ab6048b tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:27 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Volume volume-c55014c5-e4b8-4028-a709-397b1888d24d (c55014c5-e4b8-4028-a709-397b1888d24d): created successfully Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb20565-4d71-4e2e-a18c-03d456dff288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Flow 'volume_create_manager' (5a244e30-f1ec-4f34-bd36-861d8730a162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f4657ab7-a54f-447b-a502-718e686299fc tempest-VolumesTransfersV355Test-72556081 None] Created volume successfully. Jul 05 17:22:27 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 Jul 05 17:22:27 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Acquiring lock "cinder-c55014c5-e4b8-4028-a709-397b1888d24d-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Lock "cinder-c55014c5-e4b8-4028-a709-397b1888d24d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Acquiring lock "cinder-quobyte-c55014c5-e4b8-4028-a709-397b1888d24d" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Lock "cinder-quobyte-c55014c5-e4b8-4028-a709-397b1888d24d" acquired by "delete_volume" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b6c9d-37c4-467f-b633-68e6b322eaa0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:28 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-7e571d62-4c17-4616-9b78-00b6ae71db9f req-72f63798-53a7-429e-9e20-ba4c7ab6048b tempest-AttachVolumeTestJSON-1672913377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884" returned: 0 in 1.222s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-7e571d62-4c17-4616-9b78-00b6ae71db9f req-72f63798-53a7-429e-9e20-ba4c7ab6048b tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.267s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-7e571d62-4c17-4616-9b78-00b6ae71db9f req-72f63798-53a7-429e-9e20-ba4c7ab6048b tempest-AttachVolumeTestJSON-1672913377 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-48577203-d7b2-4dad-82fa-ae57cb1ff884', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '311981bd-5686-4ca3-978a-daf84ef321bc', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:22:28 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d Jul 05 17:22:28 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:28 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-7e571d62-4c17-4616-9b78-00b6ae71db9f req-72f63798-53a7-429e-9e20-ba4c7ab6048b tempest-AttachVolumeTestJSON-1672913377 None] attachment_update completed successfully. Jul 05 17:22:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d" returned: 0 in 1.217s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:29 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:29 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d Jul 05 17:22:29 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8100a4b4-7f18-4fe4-be53-8a749e152307 req-2f35ee02-2157-4442-a70f-a44fc0572c86 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8100a4b4-7f18-4fe4-be53-8a749e152307 req-2f35ee02-2157-4442-a70f-a44fc0572c86 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[910cea90-999f-4f50-94fa-aa1ce887a74b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:22:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8100a4b4-7f18-4fe4-be53-8a749e152307 req-2f35ee02-2157-4442-a70f-a44fc0572c86 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:29 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 Jul 05 17:22:29 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:30 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c55014c5-e4b8-4028-a709-397b1888d24d" returned: 0 in 1.200s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Lock "cinder-quobyte-c55014c5-e4b8-4028-a709-397b1888d24d" released by "delete_volume" :: held 2.515s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Created reservations ['8049eead-692c-4968-85ba-18a6e9faf2e8', 'bdd8b261-4157-4cd9-ba75-b421e1fb400c', '42b431ff-2e2b-40bd-8fcd-d08acb36d5db', '71bb1a4e-c499-4ab8-909b-67e5785306ca'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:22:31 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8100a4b4-7f18-4fe4-be53-8a749e152307 req-2f35ee02-2157-4442-a70f-a44fc0572c86 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074" returned: 0 in 1.258s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8100a4b4-7f18-4fe4-be53-8a749e152307 req-2f35ee02-2157-4442-a70f-a44fc0572c86 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.289s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-8100a4b4-7f18-4fe4-be53-8a749e152307 req-2f35ee02-2157-4442-a70f-a44fc0572c86 tempest-AttachVolumeNegativeTest-1919246832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-f9bf26a9-8f69-4f90-b65e-edc126629074', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40020de9-bfd5-4a88-a28a-ce3e258d1875', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:22:31 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:22:31 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-8100a4b4-7f18-4fe4-be53-8a749e152307 req-2f35ee02-2157-4442-a70f-a44fc0572c86 tempest-AttachVolumeNegativeTest-1919246832 None] attachment_update completed successfully. Jul 05 17:22:32 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.092s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:32 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:22:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Deleted volume successfully. Jul 05 17:22:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-74316fb1-e7dd-45a1-a657-d22735e56958 tempest-VolumesTransfersV355Test-1876682167 None] Lock "cinder-c55014c5-e4b8-4028-a709-397b1888d24d-delete_volume" released by "delete_volume" :: held 4.021s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Flow 'volume_create_manager' (a65049d0-5d96-41cb-856b-6fa384b71996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212650bb-da30-4c4a-a812-3d482906790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212650bb-da30-4c4a-a812-3d482906790f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-913093162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc49a09-a9d7-4da9-97ed-b16e646501d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f593eed8a94eb9afa812743b74d6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:35Z,use_quota=True,user_id='edb86e021e3240bd8df5be6d05f45b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12e5339-2798-4a73-9309-9585aaa7e219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12e5339-2798-4a73-9309-9585aaa7e219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d715537f-84b8-4142-bb7e-ea1e9b2f255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d715537f-84b8-4142-bb7e-ea1e9b2f255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc49a09-a9d7-4da9-97ed-b16e646501d0', 'volume_name': 'volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7a0c6e-93cf-4486-8203-1e1985c85433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7a0c6e-93cf-4486-8203-1e1985c85433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee011e2-9be0-46e9-a2cd-8c9c220f6de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:35 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Volume 9cc49a09-a9d7-4da9-97ed-b16e646501d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0', 'volume_size': 1} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-913093162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc49a09-a9d7-4da9-97ed-b16e646501d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f593eed8a94eb9afa812743b74d6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:35Z,use_quota=True,user_id='edb86e021e3240bd8df5be6d05f45b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Creating volume 9cc49a09-a9d7-4da9-97ed-b16e646501d0 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:22:35 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:22:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:35 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 1073741824 Jul 05 17:22:35 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:37 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 1073741824" returned: 0 in 1.439s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:37 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 Jul 05 17:22:37 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:38 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0" returned: 0 in 1.150s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] <== create_volume: return (2666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:22:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.670s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee011e2-9be0-46e9-a2cd-8c9c220f6de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f6abee-d391-4cba-89c6-771472578533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:38 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Volume volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 (9cc49a09-a9d7-4da9-97ed-b16e646501d0): created successfully Jul 05 17:22:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f6abee-d391-4cba-89c6-771472578533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Flow 'volume_create_manager' (a65049d0-5d96-41cb-856b-6fa384b71996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-97d3b6cd-8b53-4c9f-95a5-720d18853b81 tempest-AttachVolumeTestJSON-1672913377 None] Created volume successfully. Jul 05 17:22:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-036e1886-d2ca-4ef5-b9a2-d92454df061f req-5b3e9dc5-af7a-4939-b5f6-69c9ed2a0b1f tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-036e1886-d2ca-4ef5-b9a2-d92454df061f req-5b3e9dc5-af7a-4939-b5f6-69c9ed2a0b1f tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:42 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[24318ba9-359e-43ef-a610-2a93d3f8fcea]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:22:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-036e1886-d2ca-4ef5-b9a2-d92454df061f req-5b3e9dc5-af7a-4939-b5f6-69c9ed2a0b1f tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:42 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 Jul 05 17:22:42 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:43 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-036e1886-d2ca-4ef5-b9a2-d92454df061f req-5b3e9dc5-af7a-4939-b5f6-69c9ed2a0b1f tempest-AttachVolumeTestJSON-1672913377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0" returned: 0 in 1.119s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-036e1886-d2ca-4ef5-b9a2-d92454df061f req-5b3e9dc5-af7a-4939-b5f6-69c9ed2a0b1f tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.141s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-036e1886-d2ca-4ef5-b9a2-d92454df061f req-5b3e9dc5-af7a-4939-b5f6-69c9ed2a0b1f tempest-AttachVolumeTestJSON-1672913377 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae81efb9-756e-4d8d-a7a6-646eda887379', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:22:43 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-036e1886-d2ca-4ef5-b9a2-d92454df061f req-5b3e9dc5-af7a-4939-b5f6-69c9ed2a0b1f tempest-AttachVolumeTestJSON-1672913377 None] attachment_update completed successfully. Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Flow 'volume_create_manager' (8ff3acf9-e3b6-4056-ad3b-affb88541b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf69bb5-3e40-46dc-ad10-a68f78b83d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf69bb5-3e40-46dc-ad10-a68f78b83d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1842363415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343061e0-6b18-441e-ac3a-e5bff61b4f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7686f536a6934f80ae4e40909da40fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:45Z,use_quota=True,user_id='1f2f4facacd54a6b86031521ddb1ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26df25a-d2dd-4d23-9fba-30ee7de29203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26df25a-d2dd-4d23-9fba-30ee7de29203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1725d2-1076-4c78-b829-72cb7e7883c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1725d2-1076-4c78-b829-72cb7e7883c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343061e0-6b18-441e-ac3a-e5bff61b4f66', 'volume_name': 'volume-343061e0-6b18-441e-ac3a-e5bff61b4f66', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3560051-30b4-48cb-b153-a04d42d41ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3560051-30b4-48cb-b153-a04d42d41ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f7c294-1ebf-4aca-9daa-bd395af1327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:45 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Volume 343061e0-6b18-441e-ac3a-e5bff61b4f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343061e0-6b18-441e-ac3a-e5bff61b4f66', 'volume_size': 1} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1842363415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343061e0-6b18-441e-ac3a-e5bff61b4f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7686f536a6934f80ae4e40909da40fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:45Z,use_quota=True,user_id='1f2f4facacd54a6b86031521ddb1ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Creating volume 343061e0-6b18-441e-ac3a-e5bff61b4f66 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:22:45 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:22:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:45 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 1073741824 Jul 05 17:22:45 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:46 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 1073741824" returned: 0 in 0.991s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:46 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 Jul 05 17:22:46 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:47 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66" returned: 0 in 1.219s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] <== create_volume: return (2270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:22:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f7c294-1ebf-4aca-9daa-bd395af1327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343061e0-6b18-441e-ac3a-e5bff61b4f66', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a58958b-ed44-4edf-be06-d0e44f37b00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:47 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Volume volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 (343061e0-6b18-441e-ac3a-e5bff61b4f66): created successfully Jul 05 17:22:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a58958b-ed44-4edf-be06-d0e44f37b00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Flow 'volume_create_manager' (8ff3acf9-e3b6-4056-ad3b-affb88541b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ded2ad30-cb03-43e1-b66e-2ab003b4ca08 tempest-ServerRescueNegativeTestJSON-1312347300 None] Created volume successfully. Jul 05 17:22:50 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-7c02f2d3-c831-4881-9cf9-5b32dd2a8093 req-60655c78-55ad-465b-a823-0f31e1c09aeb tempest-AttachVolumeTestJSON-1672913377 None] Terminate volume connection completed successfully. Jul 05 17:22:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-7c02f2d3-c831-4881-9cf9-5b32dd2a8093 req-60655c78-55ad-465b-a823-0f31e1c09aeb tempest-AttachVolumeTestJSON-1672913377 None] Deleting attachment 311981bd-5686-4ca3-978a-daf84ef321bc. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:22:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:22:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:50 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:22:50 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:51 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.979s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:22:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:22:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 8 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:22:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Flow 'volume_create_manager' (518e79c5-a2be-47e2-9526-0f2a037e37c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2329ab-02c1-4059-bdca-c6093938ef8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2329ab-02c1-4059-bdca-c6093938ef8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1936124398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0f6918-b9e5-4081-9aee-07a735a58e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42896d8eedd411d973bacd9c3f04425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:55Z,use_quota=True,user_id='5e0f3499c17e4d74b3502bedfa5856cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db81c60d-56aa-49e9-9b31-0558d6449141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db81c60d-56aa-49e9-9b31-0558d6449141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877be6c6-9b22-4267-98d4-13cc61b90031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877be6c6-9b22-4267-98d4-13cc61b90031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0f6918-b9e5-4081-9aee-07a735a58e62', 'volume_name': 'volume-6a0f6918-b9e5-4081-9aee-07a735a58e62', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d325d6e6-120e-473f-8c43-3b8e6e415504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d325d6e6-120e-473f-8c43-3b8e6e415504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fe304b-fb25-4d0f-8abb-d9a721040b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:55 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Volume 6a0f6918-b9e5-4081-9aee-07a735a58e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0f6918-b9e5-4081-9aee-07a735a58e62', 'volume_size': 1} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1936124398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0f6918-b9e5-4081-9aee-07a735a58e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42896d8eedd411d973bacd9c3f04425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:22:55Z,use_quota=True,user_id='5e0f3499c17e4d74b3502bedfa5856cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Creating volume 6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:22:55 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:55 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 1073741824 Jul 05 17:22:55 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-3f5b9b3b-a089-4f1f-8cba-455868381ed9 req-4aa6786b-6c26-474e-83eb-3109abb84e3d tempest-AttachVolumeTestJSON-1672913377 None] Terminate volume connection completed successfully. Jul 05 17:22:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-3f5b9b3b-a089-4f1f-8cba-455868381ed9 req-4aa6786b-6c26-474e-83eb-3109abb84e3d tempest-AttachVolumeTestJSON-1672913377 None] Deleting attachment ae81efb9-756e-4d8d-a7a6-646eda887379. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:22:56 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 1073741824" returned: 0 in 1.113s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:22:56 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:22:56 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:22:57 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Jul 05 17:22:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 1.051s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:22:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:22:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:22:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fe304b-fb25-4d0f-8abb-d9a721040b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0f6918-b9e5-4081-9aee-07a735a58e62', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d7b94e-c824-4885-bb77-2de40c6e389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:22:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Volume volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 (6a0f6918-b9e5-4081-9aee-07a735a58e62): created successfully Jul 05 17:22:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d7b94e-c824-4885-bb77-2de40c6e389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:22:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Flow 'volume_create_manager' (518e79c5-a2be-47e2-9526-0f2a037e37c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:22:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ca11ade4-735e-4e6d-a880-61ddf36cf7cb tempest-VolumesActionsTest-1393655096 None] Created volume successfully. Jul 05 17:23:07 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=52,cinder:INSERT=12,cinder:UPDATE=53,cinder:DELETE=4 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:23:07 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=53,cinder:SELECT=49,cinder:INSERT=8,cinder:DELETE=7 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:23:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "cinder-9cc49a09-a9d7-4da9-97ed-b16e646501d0-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-9cc49a09-a9d7-4da9-97ed-b16e646501d0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "cinder-quobyte-9cc49a09-a9d7-4da9-97ed-b16e646501d0" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-quobyte-9cc49a09-a9d7-4da9-97ed-b16e646501d0" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:09 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[064f1b3c-32b3-49d7-99fa-c12874e61574]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:23:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:09 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 Jul 05 17:23:09 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:10 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0" returned: 0 in 0.899s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:10 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0 Jul 05 17:23:10 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:10 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9cc49a09-a9d7-4da9-97ed-b16e646501d0" returned: 0 in 0.946s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-quobyte-9cc49a09-a9d7-4da9-97ed-b16e646501d0" released by "delete_volume" :: held 1.930s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Created reservations ['45c4cbeb-d21f-4c80-82f7-c5fc1f9484fe', 'b7f96a19-06a8-4498-929e-e1c456cb7382', '1f1f946d-5103-43d0-870e-6d66ac3ba350', '3f476a3d-c600-415e-9803-e3764f82bb81'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:11 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:23:11 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "cinder-48577203-d7b2-4dad-82fa-ae57cb1ff884-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-48577203-d7b2-4dad-82fa-ae57cb1ff884-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "cinder-quobyte-48577203-d7b2-4dad-82fa-ae57cb1ff884" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-quobyte-48577203-d7b2-4dad-82fa-ae57cb1ff884" acquired by "delete_volume" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bb2176-18c2-42df-9f3d-efde7c6ad775]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:23:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:11 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 Jul 05 17:23:11 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:12 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.351s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:12 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:23:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Deleted volume successfully. Jul 05 17:23:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-880092b1-bb0c-49fc-ad95-414c71dd354f tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-9cc49a09-a9d7-4da9-97ed-b16e646501d0-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:12 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884" returned: 0 in 1.110s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:12 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884 Jul 05 17:23:12 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:14 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-48577203-d7b2-4dad-82fa-ae57cb1ff884" returned: 0 in 1.559s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-quobyte-48577203-d7b2-4dad-82fa-ae57cb1ff884" released by "delete_volume" :: held 2.768s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Acquiring lock "cinder-343061e0-6b18-441e-ac3a-e5bff61b4f66-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Created reservations ['cea8a41c-5383-41f2-932b-65a2569e97c9', '02dfb1c1-f543-4893-ade7-c9ba75af92aa', '18837d30-e4ce-49a4-ba8b-51f08edc668b', 'e238fe13-8585-486a-b0fd-1dab6f0258ef'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "cinder-343061e0-6b18-441e-ac3a-e5bff61b4f66-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Acquiring lock "cinder-quobyte-343061e0-6b18-441e-ac3a-e5bff61b4f66" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "cinder-quobyte-343061e0-6b18-441e-ac3a-e5bff61b4f66" acquired by "delete_volume" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e792c6-59f9-4752-b229-9173623b6c95]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:23:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:14 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:23:14 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:14 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 Jul 05 17:23:14 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "cinder-fd07893c-5066-48ac-89ce-760bf2c2d1c1-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-fd07893c-5066-48ac-89ce-760bf2c2d1c1-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "cinder-quobyte-fd07893c-5066-48ac-89ce-760bf2c2d1c1" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-quobyte-fd07893c-5066-48ac-89ce-760bf2c2d1c1" acquired by "delete_volume" :: waited 0.062s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f948350e-c63c-4603-aa19-5439f006d6d4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:15 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.949s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:23:15 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Deleted volume successfully. Jul 05 17:23:15 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 Jul 05 17:23:15 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f17f6c4a-917a-41ba-a73b-70e00e8c0d95 tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-48577203-d7b2-4dad-82fa-ae57cb1ff884-delete_volume" released by "delete_volume" :: held 4.311s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:16 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66" returned: 0 in 1.297s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:16 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66 Jul 05 17:23:16 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:16 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1" returned: 0 in 1.060s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:16 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1 Jul 05 17:23:16 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:17 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-343061e0-6b18-441e-ac3a-e5bff61b4f66" returned: 0 in 0.960s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "cinder-quobyte-343061e0-6b18-441e-ac3a-e5bff61b4f66" released by "delete_volume" :: held 2.358s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Created reservations ['3ea7c368-3608-418d-b0b0-1aae400b6218', 'cc87c998-a597-47e6-b713-47dd0ab49725', '897caa86-b839-4d0f-96c3-150ec2d685c9', 'e8bd0314-bbf2-4a7d-88f0-1d5a9d90b61e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:17 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:23:17 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:17 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd07893c-5066-48ac-89ce-760bf2c2d1c1" returned: 0 in 1.078s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-quobyte-fd07893c-5066-48ac-89ce-760bf2c2d1c1" released by "delete_volume" :: held 2.219s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Created reservations ['c34be2e5-6dfe-495d-8318-c9ec30198ac8', '8a942da5-b447-41f8-82e3-95a55a6bcd15', '914fe449-47cd-4151-8463-25313a815693', '2e727e98-2336-4e05-a809-aafcba4ea432'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:17 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:23:17 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:18 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.319s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:18 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:23:18 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Deleted volume successfully. Jul 05 17:23:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8e8a67c-5765-4447-bedf-df234082fcf9 tempest-ServerRescueNegativeTestJSON-1312347300 None] Lock "cinder-343061e0-6b18-441e-ac3a-e5bff61b4f66-delete_volume" released by "delete_volume" :: held 4.132s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4944647d-8a91-4bee-bab4-1d067e0afefa tempest-VolumesActionsTest-1393655096 None] Acquiring lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62" by "attach_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4944647d-8a91-4bee-bab4-1d067e0afefa tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62" acquired by "attach_volume" :: waited 0.038s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4944647d-8a91-4bee-bab4-1d067e0afefa tempest-VolumesActionsTest-1393655096 None] Attaching volume 6a0f6918-b9e5-4081-9aee-07a735a58e62 to instance af078a0e-9310-4da7-a968-011f495f53dc at mountpoint /dev/vdb on host None. Jul 05 17:23:19 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.239s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:19 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:23:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Deleted volume successfully. Jul 05 17:23:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4944647d-8a91-4bee-bab4-1d067e0afefa tempest-VolumesActionsTest-1393655096 None] Attach volume completed successfully. Jul 05 17:23:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4944647d-8a91-4bee-bab4-1d067e0afefa tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62" released by "attach_volume" :: held 0.281s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3004466b-4d6d-4235-aed9-c08a89499f45 tempest-AttachVolumeTestJSON-1672913377 None] Lock "cinder-fd07893c-5066-48ac-89ce-760bf2c2d1c1-delete_volume" released by "delete_volume" :: held 3.883s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9509a3ed-ff6c-4007-aba6-fbf30c85f28d tempest-VolumesActionsTest-1393655096 None] Acquiring lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-detach_volume" by "detach_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9509a3ed-ff6c-4007-aba6-fbf30c85f28d tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9509a3ed-ff6c-4007-aba6-fbf30c85f28d tempest-VolumesActionsTest-1393655096 None] Detaching volume 6a0f6918-b9e5-4081-9aee-07a735a58e62 from instance af078a0e-9310-4da7-a968-011f495f53dc. Jul 05 17:23:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9509a3ed-ff6c-4007-aba6-fbf30c85f28d tempest-VolumesActionsTest-1393655096 None] Detach volume completed successfully. Jul 05 17:23:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9509a3ed-ff6c-4007-aba6-fbf30c85f28d tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:29 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=35,cinder:DELETE=4 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:23:29 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=35,cinder:SELECT=23,cinder:INSERT=11 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:23:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-67f7c5d1-b290-49b5-81a8-0bd48dc17e2e tempest-BackendsCapabilitiesAdminTestsJSON-202356468 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86459) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 17:23:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b78cc0d-b258-4553-9e66-5b2b789f001c tempest-BackendsCapabilitiesAdminTestsJSON-202356468 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86459) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 17:23:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-54facd52-6053-4cfe-9cf3-d3dd53438981 tempest-GroupsTest-1200942585 None] Group tempest-Group1-1107792343: creating Jul 05 17:23:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-54facd52-6053-4cfe-9cf3-d3dd53438981 tempest-GroupsTest-1200942585 None] Group tempest-Group1-1107792343: created successfully Jul 05 17:23:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-54facd52-6053-4cfe-9cf3-d3dd53438981 tempest-GroupsTest-1200942585 None] Create group completed successfully. Jul 05 17:23:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-81530491-5fe5-4f36-9ae5-a936a387ea76 tempest-GroupsTest-1200942585 None] Group tempest-Group2-1168592367: creating Jul 05 17:23:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-81530491-5fe5-4f36-9ae5-a936a387ea76 tempest-GroupsTest-1200942585 None] Group tempest-Group2-1168592367: created successfully Jul 05 17:23:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-81530491-5fe5-4f36-9ae5-a936a387ea76 tempest-GroupsTest-1200942585 None] Create group completed successfully. Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Flow 'volume_create_manager' (9a700d2c-0e9d-4dae-9995-9dc4ae337dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e67148-5e44-4f97-9164-bb298d6aa200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e67148-5e44-4f97-9164-bb298d6aa200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1677900532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e4b3049-1d94-4d5e-842d-19800626efbd,host='devstack@QuobyteHD#QuobyteHD',id=a2d57a54-98b2-45ca-a5f8-c0acba76f4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea6a76c95db442da84d058fb46ecda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:40Z,use_quota=True,user_id='dd7094b770314bb6be2814236a9741ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(711b7e2c-c6da-4071-9771-5e0557175513),volume_type_id=711b7e2c-c6da-4071-9771-5e0557175513)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07a960-3c0a-42f2-97cd-a260eb32b200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07a960-3c0a-42f2-97cd-a260eb32b200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c97e23-0efe-43c7-8b83-69b0fc84920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c97e23-0efe-43c7-8b83-69b0fc84920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d57a54-98b2-45ca-a5f8-c0acba76f4b8', 'volume_name': 'volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ee6d06-aa58-460a-a3ec-f45d29ac6868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ee6d06-aa58-460a-a3ec-f45d29ac6868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4401d5-4cca-4bc1-9197-ecce0d170b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Volume a2d57a54-98b2-45ca-a5f8-c0acba76f4b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8', 'volume_size': 1} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e4b3049-1d94-4d5e-842d-19800626efbd,created_at=2026-07-05T15:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1677900532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e4b3049-1d94-4d5e-842d-19800626efbd,host='devstack@QuobyteHD#QuobyteHD',id=a2d57a54-98b2-45ca-a5f8-c0acba76f4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea6a76c95db442da84d058fb46ecda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:40Z,use_quota=True,user_id='dd7094b770314bb6be2814236a9741ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(711b7e2c-c6da-4071-9771-5e0557175513),volume_type_id=711b7e2c-c6da-4071-9771-5e0557175513)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Creating volume a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:23:40 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:40 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 1073741824 Jul 05 17:23:40 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-f1891628-eee2-487e-b208-988299648a6f req-2eae97e3-e732-4363-b73c-ce6be25769fb tempest-AttachVolumeNegativeTest-1919246832 None] Terminate volume connection completed successfully. Jul 05 17:23:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-f1891628-eee2-487e-b208-988299648a6f req-2eae97e3-e732-4363-b73c-ce6be25769fb tempest-AttachVolumeNegativeTest-1919246832 None] Deleting attachment 40020de9-bfd5-4a88-a28a-ce3e258d1875. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:23:41 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 1073741824" returned: 0 in 1.088s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:41 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 Jul 05 17:23:41 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:42 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8" returned: 0 in 1.000s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:23:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4401d5-4cca-4bc1-9197-ecce0d170b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ae2fd5-0914-4c00-9649-2664b65498ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:42 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Volume volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 (a2d57a54-98b2-45ca-a5f8-c0acba76f4b8): created successfully Jul 05 17:23:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ae2fd5-0914-4c00-9649-2664b65498ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Flow 'volume_create_manager' (9a700d2c-0e9d-4dae-9995-9dc4ae337dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-24ea764f-5a0f-4ddf-9520-663fb8097d0e tempest-GroupsTest-1200942585 None] Created volume successfully. Jul 05 17:23:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Acquiring lock "cinder-quobyte-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Lock "cinder-quobyte-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f230e14c-e42f-496e-9b9c-e541fc12dab2]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:23:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:45 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 Jul 05 17:23:45 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Flow 'volume_create_manager' (a40c8460-2e89-451e-a615-1e173a524cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1109276b-416b-4e8c-8d51-98d656a06c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1109276b-416b-4e8c-8d51-98d656a06c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-357541816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd24d6af-9736-4f6c-867f-6e3c3a6af931,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe9f6a4b343b413e8a1ff653cca900ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:46Z,use_quota=True,user_id='470452d618f44293a473acc2cf1f334c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e64f726-dc4c-4303-a7a3-ac79b916d01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e64f726-dc4c-4303-a7a3-ac79b916d01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc9c1d8-295f-478f-ae39-81f3f68ca9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc9c1d8-295f-478f-ae39-81f3f68ca9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd24d6af-9736-4f6c-867f-6e3c3a6af931', 'volume_name': 'volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f1b64a-86cc-4f11-bb71-95f4526160b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f1b64a-86cc-4f11-bb71-95f4526160b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152e0e02-f4a5-47c8-a18a-e3ff491740cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:46 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Volume dd24d6af-9736-4f6c-867f-6e3c3a6af931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931', 'volume_size': 1} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-357541816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd24d6af-9736-4f6c-867f-6e3c3a6af931,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe9f6a4b343b413e8a1ff653cca900ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:46Z,use_quota=True,user_id='470452d618f44293a473acc2cf1f334c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Creating volume dd24d6af-9736-4f6c-867f-6e3c3a6af931 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:23:46 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:46 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8" returned: 0 in 1.719s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:46 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 1073741824 Jul 05 17:23:46 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:46 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8 Jul 05 17:23:46 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f9019d53-3b42-488f-b76a-7b61b58b0054 tempest-VolumesActionsTest-1393655096 None] Acquiring lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62" by "attach_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f9019d53-3b42-488f-b76a-7b61b58b0054 tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62" acquired by "attach_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f9019d53-3b42-488f-b76a-7b61b58b0054 tempest-VolumesActionsTest-1393655096 None] Attaching volume 6a0f6918-b9e5-4081-9aee-07a735a58e62 to instance e4fabccf-79bc-48de-b258-041e2e0d514d at mountpoint /dev/vdb on host None. Jul 05 17:23:47 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8" returned: 0 in 1.229s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Lock "cinder-quobyte-a2d57a54-98b2-45ca-a5f8-c0acba76f4b8" released by "delete_volume" :: held 3.014s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:47 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 1073741824" returned: 0 in 1.327s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f9019d53-3b42-488f-b76a-7b61b58b0054 tempest-VolumesActionsTest-1393655096 None] Attach volume completed successfully. Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f9019d53-3b42-488f-b76a-7b61b58b0054 tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62" released by "attach_volume" :: held 0.261s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Created reservations ['81e7e43f-b971-496e-8743-6929758188b0'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:23:48 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 Jul 05 17:23:48 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:48 devstack cinder-volume[86459]: WARNING cinder.quota [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-207178329 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-207178329, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:23:48 devstack cinder-volume[86459]: WARNING cinder.quota [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-207178329 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-207178329, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Created reservations ['c56dfc95-470c-4717-b42d-fddc44767723', '1100c839-5f0b-4496-95ca-68c892f03cef', '44621596-9e51-4d7d-bc6a-a39d7305c100', '62fb3572-5667-4ca2-8b24-2271891bfd79'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:48 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:23:48 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8ae1947-4ddb-427b-a5b7-447425cef5f2 tempest-VolumesActionsTest-1393655096 None] Acquiring lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-detach_volume" by "detach_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8ae1947-4ddb-427b-a5b7-447425cef5f2 tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b8ae1947-4ddb-427b-a5b7-447425cef5f2 tempest-VolumesActionsTest-1393655096 None] Detaching volume 6a0f6918-b9e5-4081-9aee-07a735a58e62 from instance e4fabccf-79bc-48de-b258-041e2e0d514d. Jul 05 17:23:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b8ae1947-4ddb-427b-a5b7-447425cef5f2 tempest-VolumesActionsTest-1393655096 None] Detach volume completed successfully. Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8ae1947-4ddb-427b-a5b7-447425cef5f2 tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:48 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931" returned: 0 in 0.831s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152e0e02-f4a5-47c8-a18a-e3ff491740cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e1ca8e-2e5e-4d99-baee-eaae1557c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Volume volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 (dd24d6af-9736-4f6c-867f-6e3c3a6af931): created successfully Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e1ca8e-2e5e-4d99-baee-eaae1557c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Flow 'volume_create_manager' (a40c8460-2e89-451e-a615-1e173a524cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-d94a2c63-737d-4887-bd78-160fbdd3044f req-89151f92-60fe-4c91-a9db-774ab1d16d36 tempest-VolumesGetTestJSON-269363674 None] Created volume successfully. Jul 05 17:23:49 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.760s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:23:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b9bf6d7d-67e9-44b2-bb44-e714767ad69c tempest-GroupsTest-1200942585 None] Delete group completed successfully. Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Created reservations ['53e5f7e8-2edc-44cb-9827-9ee48cb61497'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:49 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:23:49 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:50 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.692s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:23:50 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2419938a-f43c-4e5b-a135-3e8012194dc2 tempest-GroupsTest-1200942585 None] Delete group completed successfully. Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Acquiring lock "cinder-dd24d6af-9736-4f6c-867f-6e3c3a6af931-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Lock "cinder-dd24d6af-9736-4f6c-867f-6e3c3a6af931-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Acquiring lock "cinder-quobyte-dd24d6af-9736-4f6c-867f-6e3c3a6af931" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Lock "cinder-quobyte-dd24d6af-9736-4f6c-867f-6e3c3a6af931" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[650c7e84-8f32-4500-98c4-ba2f8f9bc3f0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:50 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 Jul 05 17:23:50 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:50 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:23:50 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f4d989fc-2932-4ee5-b629-97ec8ec25057 tempest-GroupsTest-1200942585 None] Group tempest-GroupsTest-Group-907523097: creating Jul 05 17:23:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f4d989fc-2932-4ee5-b629-97ec8ec25057 tempest-GroupsTest-1200942585 None] Group tempest-GroupsTest-Group-907523097: created successfully Jul 05 17:23:51 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931" returned: 0 in 0.967s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f4d989fc-2932-4ee5-b629-97ec8ec25057 tempest-GroupsTest-1200942585 None] Create group completed successfully. Jul 05 17:23:51 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931 Jul 05 17:23:51 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:51 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.950s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 8 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:23:51 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dd24d6af-9736-4f6c-867f-6e3c3a6af931" returned: 0 in 0.838s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Lock "cinder-quobyte-dd24d6af-9736-4f6c-867f-6e3c3a6af931" released by "delete_volume" :: held 1.850s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:52 devstack cinder-volume[86459]: DEBUG cinder.quota [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Created reservations ['4905ca02-cb24-494a-ac14-18380d7af295', 'ff120288-da5e-4eed-847b-5982e00aff0c', 'ec03503d-95ec-4291-be6d-409905e51e71', 'b1df509a-ac35-463c-892f-adea00ba30a4'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:23:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:52 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:23:52 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Flow 'volume_create_manager' (4ef6aa6f-094e-46aa-a317-590df9e23d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75887c7-24e5-4ec4-bd36-54462b6a85f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:53 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.971s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.manager [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:23:53 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Deleted volume successfully. Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75887c7-24e5-4ec4-bd36-54462b6a85f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1228967556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15fc15a-76b5-469b-8cc8-0f246298fd9d,host='devstack@QuobyteHD#QuobyteHD',id=24825f06-122f-4f5b-a301-666d89b97a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea6a76c95db442da84d058fb46ecda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:53Z,use_quota=True,user_id='dd7094b770314bb6be2814236a9741ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4089fa36-7771-4fd3-8627-0735019d4aac),volume_type_id=4089fa36-7771-4fd3-8627-0735019d4aac)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7123ce04-0fb5-4006-b8e7-bfbbb9320ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7123ce04-0fb5-4006-b8e7-bfbbb9320ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ef9ca9-92b8-4681-a28b-4f8b330d8793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ef9ca9-92b8-4681-a28b-4f8b330d8793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24825f06-122f-4f5b-a301-666d89b97a67', 'volume_name': 'volume-24825f06-122f-4f5b-a301-666d89b97a67', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a33ed5c-34e2-4df1-9220-866be3c2885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a33ed5c-34e2-4df1-9220-866be3c2885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25db5a0-ae56-4ae2-b56f-027a35dd9cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:53 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Volume 24825f06-122f-4f5b-a301-666d89b97a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24825f06-122f-4f5b-a301-666d89b97a67', 'volume_size': 1} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f15fc15a-76b5-469b-8cc8-0f246298fd9d,created_at=2026-07-05T15:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1228967556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15fc15a-76b5-469b-8cc8-0f246298fd9d,host='devstack@QuobyteHD#QuobyteHD',id=24825f06-122f-4f5b-a301-666d89b97a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea6a76c95db442da84d058fb46ecda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:53Z,use_quota=True,user_id='dd7094b770314bb6be2814236a9741ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4089fa36-7771-4fd3-8627-0735019d4aac),volume_type_id=4089fa36-7771-4fd3-8627-0735019d4aac)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Creating volume 24825f06-122f-4f5b-a301-666d89b97a67 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:23:53 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:53 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 1073741824 Jul 05 17:23:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-9883d4d3-de81-416e-a2ed-52cec2fa4857 req-e4a839e9-9c39-4aab-9247-3a93949b07eb tempest-VolumesGetTestJSON-269363674 None] Lock "cinder-dd24d6af-9736-4f6c-867f-6e3c3a6af931-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:23:53 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:54 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 1073741824" returned: 0 in 1.058s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:54 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 Jul 05 17:23:54 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:55 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67" returned: 0 in 0.714s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:23:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25db5a0-ae56-4ae2-b56f-027a35dd9cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24825f06-122f-4f5b-a301-666d89b97a67', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48849ed6-1adb-4e67-b824-c4287783e25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:55 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Volume volume-24825f06-122f-4f5b-a301-666d89b97a67 (24825f06-122f-4f5b-a301-666d89b97a67): created successfully Jul 05 17:23:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48849ed6-1adb-4e67-b824-c4287783e25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Flow 'volume_create_manager' (4ef6aa6f-094e-46aa-a317-590df9e23d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-64cc35e3-aef6-4f01-969c-20c1b0accf4b tempest-GroupsTest-1200942585 None] Created volume successfully. Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Flow 'volume_create_manager' (c936a5df-c9e0-4855-a167-7af61e917c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6dad2b-087f-4fbf-9ad8-eeae003d2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6dad2b-087f-4fbf-9ad8-eeae003d2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296560801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15fc15a-76b5-469b-8cc8-0f246298fd9d,host='devstack@QuobyteHD#QuobyteHD',id=64eebd8a-857a-4f11-9311-811ad8ebbace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea6a76c95db442da84d058fb46ecda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:56Z,use_quota=True,user_id='dd7094b770314bb6be2814236a9741ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4089fa36-7771-4fd3-8627-0735019d4aac),volume_type_id=4089fa36-7771-4fd3-8627-0735019d4aac)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ad82c6-ab05-46c8-a22b-b39def1fb9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ad82c6-ab05-46c8-a22b-b39def1fb9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6481c4c-7498-427c-a2fb-235d6b437a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6481c4c-7498-427c-a2fb-235d6b437a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64eebd8a-857a-4f11-9311-811ad8ebbace', 'volume_name': 'volume-64eebd8a-857a-4f11-9311-811ad8ebbace', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9edf82-89ed-46c5-87c3-dfa40d5edef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9edf82-89ed-46c5-87c3-dfa40d5edef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4b3a6c-b62a-47d8-ad8a-98efa633f4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:56 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Volume 64eebd8a-857a-4f11-9311-811ad8ebbace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64eebd8a-857a-4f11-9311-811ad8ebbace', 'volume_size': 1} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f15fc15a-76b5-469b-8cc8-0f246298fd9d,created_at=2026-07-05T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296560801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15fc15a-76b5-469b-8cc8-0f246298fd9d,host='devstack@QuobyteHD#QuobyteHD',id=64eebd8a-857a-4f11-9311-811ad8ebbace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea6a76c95db442da84d058fb46ecda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:56Z,use_quota=True,user_id='dd7094b770314bb6be2814236a9741ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4089fa36-7771-4fd3-8627-0735019d4aac),volume_type_id=4089fa36-7771-4fd3-8627-0735019d4aac)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Creating volume 64eebd8a-857a-4f11-9311-811ad8ebbace {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:23:56 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:23:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:56 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace 1073741824 Jul 05 17:23:56 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Flow 'volume_create_manager' (a0e29b19-3512-4efa-b905-740b24587721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df744494-13e6-4e03-bc69-3a83a729492c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df744494-13e6-4e03-bc69-3a83a729492c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1936836746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bee6f8c-50b7-4f87-947c-6b915a56d0ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1aac440570a4a1c9fc51d16ab07c8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:57Z,use_quota=True,user_id='e72b29e95fd0432699fde0198923d26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86050d8-95b5-46ac-b7a2-26aa2afc443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86050d8-95b5-46ac-b7a2-26aa2afc443f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d97084-a1cc-4671-be66-acae7fa5ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d97084-a1cc-4671-be66-acae7fa5ad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bee6f8c-50b7-4f87-947c-6b915a56d0ca', 'volume_name': 'volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d793df8-56fb-4c90-a4bf-8de52eb40f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d793df8-56fb-4c90-a4bf-8de52eb40f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914278d5-17c0-4ccf-b63a-24f48b6ab62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Volume 5bee6f8c-50b7-4f87-947c-6b915a56d0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca', 'volume_size': 1} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:57 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace 1073741824" returned: 0 in 1.094s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:57 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace Jul 05 17:23:57 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:58 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace" returned: 0 in 0.664s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1936836746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bee6f8c-50b7-4f87-947c-6b915a56d0ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1aac440570a4a1c9fc51d16ab07c8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:23:57Z,use_quota=True,user_id='e72b29e95fd0432699fde0198923d26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Creating volume 5bee6f8c-50b7-4f87-947c-6b915a56d0ca {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:23:58 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4b3a6c-b62a-47d8-ad8a-98efa633f4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64eebd8a-857a-4f11-9311-811ad8ebbace', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5eadb5e-548a-4bf4-8399-c3e69f5b3554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:58 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca 1073741824 Jul 05 17:23:58 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:58 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Volume volume-64eebd8a-857a-4f11-9311-811ad8ebbace (64eebd8a-857a-4f11-9311-811ad8ebbace): created successfully Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5eadb5e-548a-4bf4-8399-c3e69f5b3554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Flow 'volume_create_manager' (c936a5df-c9e0-4855-a167-7af61e917c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b41e140a-eb7a-4f0f-a717-444dd6eeb703 tempest-GroupsTest-1200942585 None] Created volume successfully. Jul 05 17:23:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:23:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0d078860-5095-4c6d-886e-594d7a317004 tempest-GroupsTest-1200942585 None] Update group completed successfully. Jul 05 17:23:59 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca 1073741824" returned: 0 in 0.860s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:59 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca Jul 05 17:23:59 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:23:59 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca" returned: 0 in 0.656s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.197s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914278d5-17c0-4ccf-b63a-24f48b6ab62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2234d06-dfe4-4a8c-9d3e-4e88ace24fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[484c8c44-c39c-4ef6-b62d-169d92a5040c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:23:59 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Volume volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca (5bee6f8c-50b7-4f87-947c-6b915a56d0ca): created successfully Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2234d06-dfe4-4a8c-9d3e-4e88ace24fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:23:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Flow 'volume_create_manager' (a0e29b19-3512-4efa-b905-740b24587721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:23:59 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b276a8b6-b63b-44b7-b338-2ec786d758be tempest-VolumesTestJSON-59098734 None] Created volume successfully. Jul 05 17:23:59 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:23:59 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9120b278-dc58-4608-9d23-c5a46435f8c7 tempest-GroupsTest-1200942585 None] Update group completed successfully. Jul 05 17:24:00 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 0.782s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5078fa-feee-48ab-9c47-bc8da43c70dd]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:00 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:24:00 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:00 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:24:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Flow 'volume_create_manager' (5f44a2ea-11fc-476e-8ff5-4484bd3632bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:24:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd89934-c099-4736-91f9-c037340da594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd89934-c099-4736-91f9-c037340da594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-774882187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc39d3f-97a6-464f-9377-4d8785a3502e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1aac440570a4a1c9fc51d16ab07c8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:01Z,use_quota=True,user_id='e72b29e95fd0432699fde0198923d26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe17a19c-7771-41b2-8b28-f288090fd8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe17a19c-7771-41b2-8b28-f288090fd8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fc54e1-1fa1-4f90-86c2-69d6cd6b6154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fc54e1-1fa1-4f90-86c2-69d6cd6b6154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc39d3f-97a6-464f-9377-4d8785a3502e', 'volume_name': 'volume-edc39d3f-97a6-464f-9377-4d8785a3502e', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4134b308-5e65-4861-b851-1f66836193c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4134b308-5e65-4861-b851-1f66836193c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54772b5-f727-439e-92ec-6b271f410224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:01 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Volume edc39d3f-97a6-464f-9377-4d8785a3502e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc39d3f-97a6-464f-9377-4d8785a3502e', 'volume_size': 1} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:01 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 0.809s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.a47a8518-f15f-4dde-8315-fd6456c1fe91wy6m49l_.img {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:01 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.a47a8518-f15f-4dde-8315-fd6456c1fe91wy6m49l_.img Jul 05 17:24:01 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Acquiring lock "cinder-quobyte-24825f06-122f-4f5b-a301-666d89b97a67" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Lock "cinder-quobyte-24825f06-122f-4f5b-a301-666d89b97a67" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61c95ad-4534-4471-9ad1-c494817e06b1]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:02 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 Jul 05 17:24:02 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:04 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67" returned: 0 in 2.036s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:04 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67 Jul 05 17:24:04 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:05 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24825f06-122f-4f5b-a301-666d89b97a67" returned: 0 in 1.480s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Lock "cinder-quobyte-24825f06-122f-4f5b-a301-666d89b97a67" released by "delete_volume" :: held 3.598s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Acquiring lock "cinder-quobyte-64eebd8a-857a-4f11-9311-811ad8ebbace" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Lock "cinder-quobyte-64eebd8a-857a-4f11-9311-811ad8ebbace" acquired by "delete_volume" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8adbfc6-2102-4c12-ab0f-88730dbb22c1]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:05 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace Jul 05 17:24:05 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:07 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace" returned: 0 in 1.406s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:07 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace Jul 05 17:24:07 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:07 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.a47a8518-f15f-4dde-8315-fd6456c1fe91wy6m49l_.img" returned: 0 in 6.251s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:07 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b117ff41-b78c-49c1-8d1f-6d435305cc49]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:07 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:24:07 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:07 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-64eebd8a-857a-4f11-9311-811ad8ebbace" returned: 0 in 0.874s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Lock "cinder-quobyte-64eebd8a-857a-4f11-9311-811ad8ebbace" released by "delete_volume" :: held 2.391s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Created reservations ['1eff1ae4-91c8-42ce-ab4c-f6c8d51df9a3'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:24:08 devstack cinder-volume[86459]: WARNING cinder.quota [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-511427742 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-511427742, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:24:08 devstack cinder-volume[86459]: WARNING cinder.quota [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-511427742 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-511427742, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Created reservations ['35e012dd-da89-444e-b2b0-eea808c0b2ec', 'a3fda6e1-8161-419a-9157-b38b3b240085', '1b808b16-5032-4a0d-b597-de1388e89c2f', '796f568d-aa01-4e21-9ec4-c25b8a57ac93'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Created reservations ['99c359fa-0c4a-4532-b000-586bc2942619', '2a31c39a-c397-47ac-bf51-e868230c1b7e', '2f8d6213-0c5d-41b4-8aa2-9fd84089b51b', '3651b8b1-9294-42ba-b267-7e7fc4b13e9d'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:08 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:24:08 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:08 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 0.973s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.a47a8518-f15f-4dde-8315-fd6456c1fe91wy6m49l_.img {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:24:08 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Converted 1024.00 MB image at 163.77 MB/s Jul 05 17:24:08 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] a47a8518-f15f-4dde-8315-fd6456c1fe91 was raw, no need to convert to raw {{(pid=86459) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 05 17:24:09 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.688s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:09 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:24:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-14ac2013-9902-47a6-88c6-ace7c8130826 tempest-GroupsTest-1200942585 None] Delete group completed successfully. Jul 05 17:24:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-69a43096-e1dd-4f9e-87b7-1ac5893b1880 tempest-GroupsV314Test-591156447 None] Group tempest-GroupsV314Test-Group-543367131: creating Jul 05 17:24:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-69a43096-e1dd-4f9e-87b7-1ac5893b1880 tempest-GroupsV314Test-591156447 None] Group tempest-GroupsV314Test-Group-543367131: created successfully Jul 05 17:24:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-69a43096-e1dd-4f9e-87b7-1ac5893b1880 tempest-GroupsV314Test-591156447 None] Create group completed successfully. Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Flow 'volume_create_manager' (2247363a-ef87-4dbd-8515-6f8f2853db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ad85f6-f521-4b5f-8d91-8c546edd4cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ad85f6-f521-4b5f-8d91-8c546edd4cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872212057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68076489-58f1-465c-bc12-0613d32fe205,host='devstack@QuobyteHD#QuobyteHD',id=ff759850-6b28-43cb-8aa2-6cc9553a8891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de535f72d4614954bea0eebe85a9f588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:18Z,use_quota=True,user_id='6a746b9bb59a47a79be353ce4d2dffc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21cd9f62-f362-4273-85ef-ed473cd86634),volume_type_id=21cd9f62-f362-4273-85ef-ed473cd86634)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660166cb-497c-429f-996e-43f3c0b88274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660166cb-497c-429f-996e-43f3c0b88274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e33fbb-315a-4dbf-be58-e6f4469916bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e33fbb-315a-4dbf-be58-e6f4469916bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff759850-6b28-43cb-8aa2-6cc9553a8891', 'volume_name': 'volume-ff759850-6b28-43cb-8aa2-6cc9553a8891', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a29ed34-21c8-4481-ad8e-c00c6a922fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a29ed34-21c8-4481-ad8e-c00c6a922fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2062efaa-3db4-4d61-8f85-3880374e5cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:18 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Volume ff759850-6b28-43cb-8aa2-6cc9553a8891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff759850-6b28-43cb-8aa2-6cc9553a8891', 'volume_size': 1} Jul 05 17:24:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:28 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=63,cinder:UPDATE=60,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:24:28 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=62,cinder:UPDATE=69,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.313s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Uploaded volume to glance image-id: a47a8518-f15f-4dde-8315-fd6456c1fe91. {{(pid=86459) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.020s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-774882187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc39d3f-97a6-464f-9377-4d8785a3502e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1aac440570a4a1c9fc51d16ab07c8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:01Z,use_quota=True,user_id='e72b29e95fd0432699fde0198923d26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Creating volume edc39d3f-97a6-464f-9377-4d8785a3502e {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:24:31 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:31 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e 1073741824 Jul 05 17:24:31 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5cf87c5a-ed41-4154-b2d1-52ceabadbe86 tempest-VolumesActionsTest-1393655096 None] Copy volume to image completed successfully. Jul 05 17:24:31 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e 1073741824" returned: 0 in 0.877s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:32 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e Jul 05 17:24:32 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:32 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e" returned: 0 in 0.645s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.406s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=68076489-58f1-465c-bc12-0613d32fe205,created_at=2026-07-05T15:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872212057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68076489-58f1-465c-bc12-0613d32fe205,host='devstack@QuobyteHD#QuobyteHD',id=ff759850-6b28-43cb-8aa2-6cc9553a8891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de535f72d4614954bea0eebe85a9f588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:18Z,use_quota=True,user_id='6a746b9bb59a47a79be353ce4d2dffc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21cd9f62-f362-4273-85ef-ed473cd86634),volume_type_id=21cd9f62-f362-4273-85ef-ed473cd86634)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Creating volume ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:24:32 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:32 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 1073741824 Jul 05 17:24:32 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54772b5-f727-439e-92ec-6b271f410224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc39d3f-97a6-464f-9377-4d8785a3502e', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c0b2d8-d858-4457-a5d0-2eec0bf2655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:32 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Volume volume-edc39d3f-97a6-464f-9377-4d8785a3502e (edc39d3f-97a6-464f-9377-4d8785a3502e): created successfully Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c0b2d8-d858-4457-a5d0-2eec0bf2655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Flow 'volume_create_manager' (5f44a2ea-11fc-476e-8ff5-4484bd3632bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:24:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-eddc9e50-f242-4afa-b735-192c8af15197 tempest-VolumesTestJSON-59098734 None] Created volume successfully. Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Flow 'volume_create_manager' (6ec3ce8a-4cce-4522-8e16-dddd1c8b1183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd71007-4a7c-4d95-a375-c257425976fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd71007-4a7c-4d95-a375-c257425976fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-936298285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1aac440570a4a1c9fc51d16ab07c8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:33Z,use_quota=True,user_id='e72b29e95fd0432699fde0198923d26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0bd2f2-cb50-4283-a368-65f1951987d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0bd2f2-cb50-4283-a368-65f1951987d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda53551-7068-430f-9385-c1feaf163e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:33 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda53551-7068-430f-9385-c1feaf163e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723', 'volume_name': 'volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0def935c-cb9e-406d-9f98-d7e2521e0c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0def935c-cb9e-406d-9f98-d7e2521e0c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fbd8a2-7172-4211-a697-aca19aa47c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:33 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Volume ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723', 'volume_size': 1} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 1073741824" returned: 0 in 1.000s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:33 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 Jul 05 17:24:33 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:34 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891" returned: 0 in 0.626s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.282s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2062efaa-3db4-4d61-8f85-3880374e5cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff759850-6b28-43cb-8aa2-6cc9553a8891', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8265e010-71e2-4dc3-8bd3-332c6fc9f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[78027304-716d-41fd-9696-658d625d4f26]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Volume volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 (ff759850-6b28-43cb-8aa2-6cc9553a8891): created successfully Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8265e010-71e2-4dc3-8bd3-332c6fc9f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Flow 'volume_create_manager' (2247363a-ef87-4dbd-8515-6f8f2853db82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:24:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2c355a01-5cbd-486b-934e-e4f13143fb76 tempest-GroupsV314Test-591156447 None] Created volume successfully. Jul 05 17:24:34 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:24:34 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:35 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 0.785s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[87625ed9-5ce1-4f62-a406-fb11bcac9f0a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:35 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:24:35 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:35 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 0.819s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:35 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img Jul 05 17:24:35 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:38 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:24:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Flow 'volume_create_manager' (51c4f184-f551-4ba9-a179-4f1242b3a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:24:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a484e03-6067-4a18-b095-95a6b4729db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a484e03-6067-4a18-b095-95a6b4729db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1783894694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0f3780-a6e7-42f7-b220-e6193c5390d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34995594e2a48eb912a0b36b0988862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:39Z,use_quota=True,user_id='b1bfd72a1ff14564a1c1160962f57dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c37b52-a2e0-45c6-95f0-25df9a50bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c37b52-a2e0-45c6-95f0-25df9a50bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc0163b-79e1-4f19-ba8e-9e9101dfd0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc0163b-79e1-4f19-ba8e-9e9101dfd0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0f3780-a6e7-42f7-b220-e6193c5390d5', 'volume_name': 'volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd22045-dce2-4658-9a61-fba82439ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd22045-dce2-4658-9a61-fba82439ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cf56d2-2fff-4410-8930-6e2923c8f09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:39 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Volume 2f0f3780-a6e7-42f7-b220-e6193c5390d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5', 'volume_size': 1} Jul 05 17:24:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:40 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img" returned: 0 in 5.007s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:40 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee031cc-075e-4b2c-ac2a-1b5265ddbb5b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:41 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:24:41 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:41 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 0.909s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:41 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:24:41 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Converted 1024.00 MB image at 204.47 MB/s Jul 05 17:24:41 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] 284908b3-cc6a-40ac-bbe4-1a9b1587d99d was raw, converting to qcow2 {{(pid=86459) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 05 17:24:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf91d08-7830-4922-a5e6-19d8029e0ea1]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:42 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img Jul 05 17:24:42 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:42 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:42 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img Jul 05 17:24:42 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:43 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img" returned: 1 in 0.724s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:24:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img /opt/stack/data/cinder/conversion/vol_upload_8xq5s4ya {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:43 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img /opt/stack/data/cinder/conversion/vol_upload_8xq5s4ya Jul 05 17:24:43 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:44 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img /opt/stack/data/cinder/conversion/vol_upload_8xq5s4ya" returned: 0 in 0.654s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:44 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Image conversion details: src /opt/stack/data/cinder/conversion/6a0f6918-b9e5-4081-9aee-07a735a58e62.temp_image.284908b3-cc6a-40ac-bbe4-1a9b1587d99dzgg8_0h0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8xq5s4ya {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:24:44 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 05 17:24:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d131dc8-16df-44ea-8e0b-0475793dd0d7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8xq5s4ya {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:44 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8xq5s4ya Jul 05 17:24:44 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:44 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8xq5s4ya" returned: 0 in 0.708s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.633s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Uploaded volume to glance image-id: 284908b3-cc6a-40ac-bbe4-1a9b1587d99d. {{(pid=86459) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.300s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-936298285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1aac440570a4a1c9fc51d16ab07c8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:33Z,use_quota=True,user_id='e72b29e95fd0432699fde0198923d26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Creating volume ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:24:45 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:24:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:45 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 1073741824 Jul 05 17:24:45 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:45 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-76804133-c3ad-4392-9054-b4a237c5e917 tempest-VolumesActionsTest-1393655096 None] Copy volume to image completed successfully. Jul 05 17:24:46 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 1073741824" returned: 0 in 0.813s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:46 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 Jul 05 17:24:46 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Acquiring lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Acquiring lock "cinder-quobyte-6a0f6918-b9e5-4081-9aee-07a735a58e62" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Lock "cinder-quobyte-6a0f6918-b9e5-4081-9aee-07a735a58e62" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b6fb6e-3353-4131-a4e9-c0152d103d6c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:47 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723" returned: 0 in 0.669s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.819s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:47 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Cloning volume ff759850-6b28-43cb-8aa2-6cc9553a8891 to volume b4b32fda-a0f1-4381-800c-ed48793c90d0 Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fbd8a2-7172-4211-a697-aca19aa47c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09564423-0126-4bb4-98e5-15679502a772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:47 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:24:47 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:47 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Volume volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 (ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723): created successfully Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09564423-0126-4bb4-98e5-15679502a772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Flow 'volume_create_manager' (6ec3ce8a-4cce-4522-8e16-dddd1c8b1183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Creating offline snapshot cac81b59-3fd5-45f4-a9c1-8c14654ea1af of volume ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[274fd68a-b4bc-45c5-a0bb-770baf0153ed]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f040b51f-f500-4af0-826f-129778321d74 tempest-VolumesTestJSON-59098734 None] Created volume successfully. Jul 05 17:24:47 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 Jul 05 17:24:47 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:48 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 0.786s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:48 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62 Jul 05 17:24:48 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:48 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891" returned: 0 in 0.754s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:48 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af 1G Jul 05 17:24:48 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:48 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6a0f6918-b9e5-4081-9aee-07a735a58e62" returned: 0 in 0.646s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Lock "cinder-quobyte-6a0f6918-b9e5-4081-9aee-07a735a58e62" released by "delete_volume" :: held 1.482s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:48 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Created reservations ['da13fc96-0ae4-4e0a-8954-6659b05ac806', 'a8597681-890d-463b-a2a0-6375f3a5bd64', '2e7fba17-a709-4e97-a3ed-1cd5a49ea0f7', '1edddbd7-c9c7-43e6-a40a-eac9c540163d'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:49 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:24:49 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:49 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af 1G" returned: 0 in 0.990s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:49 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af Jul 05 17:24:49 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Acquiring lock "cinder-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Lock "cinder-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Acquiring lock "cinder-quobyte-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Lock "cinder-quobyte-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a233bd-020b-4426-8b89-d72cb97fb05c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:49 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.973s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:24:50 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Deleted volume successfully. Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fa05d994-acc2-449b-a108-c37f7dd1abb2 tempest-VolumesActionsTest-1393655096 None] Lock "cinder-6a0f6918-b9e5-4081-9aee-07a735a58e62-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:50 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 Jul 05 17:24:50 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:50 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af" returned: 0 in 1.062s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:50 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:50 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af Jul 05 17:24:50 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:50 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:24:50 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:51 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723" returned: 0 in 1.068s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:51 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723 Jul 05 17:24:51 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:51 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af" returned: 0 in 0.841s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:51 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.info Jul 05 17:24:51 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:51 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.751s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:24:51 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723" returned: 0 in 0.814s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Lock "cinder-quobyte-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723" released by "delete_volume" :: held 1.941s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Created reservations ['c66097f0-c3a5-4c4f-938c-7e8e694ce2ab', '4b7c3f02-ab2c-4237-b29d-e52630bd7a2c', 'f57c018a-15cd-4bb9-a99e-342839bab805', 'c6d5aa63-675e-466b-b133-1a252c65b2f8'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:52 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:24:52 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:52 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.info" returned: 0 in 0.751s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:52 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:52 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.info Jul 05 17:24:52 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Acquiring lock "cinder-edc39d3f-97a6-464f-9377-4d8785a3502e-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Lock "cinder-edc39d3f-97a6-464f-9377-4d8785a3502e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Acquiring lock "cinder-quobyte-edc39d3f-97a6-464f-9377-4d8785a3502e" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Lock "cinder-quobyte-edc39d3f-97a6-464f-9377-4d8785a3502e" acquired by "delete_volume" :: waited 0.037s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f13ea8-de08-41cc-9699-a805b6a298e7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:52 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e Jul 05 17:24:52 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:52 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.info" returned: 0 in 0.815s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Acquiring lock "cinder-quobyte-b4b32fda-a0f1-4381-800c-ed48793c90d0" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Lock "cinder-quobyte-b4b32fda-a0f1-4381-800c-ed48793c90d0" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] snapshot: cac81b59-3fd5-45f4-a9c1-8c14654ea1af, volume: b4b32fda-a0f1-4381-800c-ed48793c90d0, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:52 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.991s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e166da3-c8ee-412f-980b-7880f4a7090a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:53 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Deleted volume successfully. Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a94bcce9-4a85-4348-bcd5-6d250ad2ed1d tempest-VolumesTestJSON-59098734 None] Lock "cinder-ab9d3fc9-1da3-4dc7-a1df-c17b8fd34723-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:53 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af Jul 05 17:24:53 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:53 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e" returned: 0 in 1.115s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:53 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e Jul 05 17:24:53 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:53 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af" returned: 0 in 0.941s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff759850-6b28-43cb-8aa2-6cc9553a8891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[474af397-4ea0-457e-93f1-b2f6b3f9cc17]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:54 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 Jul 05 17:24:54 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:54 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-edc39d3f-97a6-464f-9377-4d8785a3502e" returned: 0 in 0.770s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Lock "cinder-quobyte-edc39d3f-97a6-464f-9377-4d8785a3502e" released by "delete_volume" :: held 1.941s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Created reservations ['8f5a8aba-63f6-47b0-a112-8332d8a4a00f', 'f82a0a7a-e9b1-4ef1-a44c-b4871b8677c6', 'f5c8ea69-1454-4f19-8cf4-19df65a503d2', '28fb488e-c8e7-4c68-8665-95600d5cef93'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:54 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:24:54 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:54 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891" returned: 0 in 0.882s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:24:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:54 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 Jul 05 17:24:54 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:55 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.668s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:24:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Deleted volume successfully. Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7f76bd02-d31a-4964-b88d-f49424d68704 tempest-VolumesTestJSON-59098734 None] Lock "cinder-edc39d3f-97a6-464f-9377-4d8785a3502e-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Acquiring lock "cinder-5bee6f8c-50b7-4f87-947c-6b915a56d0ca-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Lock "cinder-5bee6f8c-50b7-4f87-947c-6b915a56d0ca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Acquiring lock "cinder-quobyte-5bee6f8c-50b7-4f87-947c-6b915a56d0ca" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Lock "cinder-quobyte-5bee6f8c-50b7-4f87-947c-6b915a56d0ca" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1645917e-6d96-4f88-a028-801f60d01d94]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:24:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:55 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca Jul 05 17:24:55 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Flow 'volume_create_manager' (04eb7b84-adf8-45f8-ac67-68a736ec157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8880a11-be11-42df-8809-82d803c7cf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8880a11-be11-42df-8809-82d803c7cf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-351773598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149f551c-538f-410e-a124-cde117bb39d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285627f5c18847b2a716b9bf1575c375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:57Z,use_quota=True,user_id='288de6b4ac48464bb35f97187620d04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdbc674-a237-4f68-8cfe-b475913724a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdbc674-a237-4f68-8cfe-b475913724a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8716d5d-71bb-4a0c-b82b-74e0ffc51f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8716d5d-71bb-4a0c-b82b-74e0ffc51f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149f551c-538f-410e-a124-cde117bb39d1', 'volume_name': 'volume-149f551c-538f-410e-a124-cde117bb39d1', 'volume_size': 2}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e77ff4-f2f7-402c-b3dc-b2b79e574844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e77ff4-f2f7-402c-b3dc-b2b79e574844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0687d0-d1a7-46e2-bff8-001802d80c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:24:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Volume 149f551c-538f-410e-a124-cde117bb39d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149f551c-538f-410e-a124-cde117bb39d1', 'volume_size': 2} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:57 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca" returned: 0 in 2.108s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:57 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca Jul 05 17:24:57 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:24:59 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5bee6f8c-50b7-4f87-947c-6b915a56d0ca" returned: 0 in 1.596s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Lock "cinder-quobyte-5bee6f8c-50b7-4f87-947c-6b915a56d0ca" released by "delete_volume" :: held 3.776s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Created reservations ['f5dce4e8-9883-496b-a137-80e603a508e7', '847e9548-5a65-4898-834e-e5a5d528a699', '60f9cee2-820a-4dbc-a410-662044454792', '91ba0d48-8190-4963-b841-09d80cb4ccfe'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:24:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:24:59 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:24:59 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:00 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0" returned: 0 in 5.420s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[93697364-6b7d-42a3-abd3-98f7c937190f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:00 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 Jul 05 17:25:00 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:00 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.947s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:00 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Deleted volume successfully. Jul 05 17:25:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-da34379b-1fba-47b8-81b4-0f47995e4356 tempest-VolumesTestJSON-59098734 None] Lock "cinder-5bee6f8c-50b7-4f87-947c-6b915a56d0ca-delete_volume" released by "delete_volume" :: held 5.067s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:01 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891" returned: 0 in 1.055s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:01 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:25:01 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Converted 1024.00 MB image at 188.87 MB/s Jul 05 17:25:01 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:25:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:01 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 Jul 05 17:25:01 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:01 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0" returned: 0 in 0.676s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Lock "cinder-quobyte-b4b32fda-a0f1-4381-800c-ed48793c90d0" released by "_copy_volume_from_snapshot" :: held 9.083s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Acquiring lock "cinder-quobyte-cac81b59-3fd5-45f4-a9c1-8c14654ea1af" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Lock "cinder-quobyte-cac81b59-3fd5-45f4-a9c1-8c14654ea1af" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Deleting offline snapshot cac81b59-3fd5-45f4-a9c1-8c14654ea1af of volume ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] snapshot_file for this snap is: volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccac3ece-dd23-4239-a288-662c8367254d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:02 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af Jul 05 17:25:02 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:02 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af" returned: 0 in 0.771s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff759850-6b28-43cb-8aa2-6cc9553a8891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d924dc2-3a02-4ba8-a4a2-416baa8f1c54]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:02 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 Jul 05 17:25:02 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:03 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891" returned: 0 in 0.805s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:03 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af Jul 05 17:25:03 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:04 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af" returned: 0 in 0.792s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:04 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af Jul 05 17:25:04 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:05 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891.cac81b59-3fd5-45f4-a9c1-8c14654ea1af" returned: 0 in 0.679s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Lock "cinder-quobyte-cac81b59-3fd5-45f4-a9c1-8c14654ea1af" released by "_delete_snapshot" :: held 3.162s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.740s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.077s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1783894694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0f3780-a6e7-42f7-b220-e6193c5390d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34995594e2a48eb912a0b36b0988862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:39Z,use_quota=True,user_id='b1bfd72a1ff14564a1c1160962f57dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Creating volume 2f0f3780-a6e7-42f7-b220-e6193c5390d5 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:05 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:05 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 1073741824 Jul 05 17:25:05 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4f0e8510-1236-464d-85c3-ca560f0583b5 tempest-GroupsV314Test-591156447 None] Create group from source-group-68076489-58f1-465c-bc12-0613d32fe205 completed successfully. Jul 05 17:25:06 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 1073741824" returned: 0 in 0.863s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:06 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 Jul 05 17:25:06 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:06 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5" returned: 0 in 0.634s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.513s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-351773598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149f551c-538f-410e-a124-cde117bb39d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285627f5c18847b2a716b9bf1575c375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:24:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:24:57Z,use_quota=True,user_id='288de6b4ac48464bb35f97187620d04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Creating volume 149f551c-538f-410e-a124-cde117bb39d1 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:06 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 2147483648 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cf56d2-2fff-4410-8930-6e2923c8f09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:06 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 2147483648 Jul 05 17:25:06 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494cc347-379f-4536-8447-460884dc130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:06 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Volume volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 (2f0f3780-a6e7-42f7-b220-e6193c5390d5): created successfully Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494cc347-379f-4536-8447-460884dc130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Flow 'volume_create_manager' (51c4f184-f551-4ba9-a179-4f1242b3a708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-84442b4d-5ff6-428f-9bbd-96dd43272679 tempest-AttachVolumeNegativeTest-1919246832 None] Created volume successfully. Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Acquiring lock "cinder-quobyte-b4b32fda-a0f1-4381-800c-ed48793c90d0" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Lock "cinder-quobyte-b4b32fda-a0f1-4381-800c-ed48793c90d0" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[218e7e24-fe5c-43b7-9f16-b16bfeeda53c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:07 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 Jul 05 17:25:07 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7997f3af-ba5c-4540-9570-ac5b585f7685 tempest-GroupSnapshotsTest-244745086 None] Group tempest-GroupSnapshotsTest-Group-130473920: creating Jul 05 17:25:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7997f3af-ba5c-4540-9570-ac5b585f7685 tempest-GroupSnapshotsTest-244745086 None] Group tempest-GroupSnapshotsTest-Group-130473920: created successfully Jul 05 17:25:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7997f3af-ba5c-4540-9570-ac5b585f7685 tempest-GroupSnapshotsTest-244745086 None] Create group completed successfully. Jul 05 17:25:07 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 2147483648" returned: 0 in 1.006s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:07 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0" returned: 0 in 0.819s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:07 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0 Jul 05 17:25:07 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:07 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 Jul 05 17:25:07 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:08 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b4b32fda-a0f1-4381-800c-ed48793c90d0" returned: 0 in 0.665s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:08 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Lock "cinder-quobyte-b4b32fda-a0f1-4381-800c-ed48793c90d0" released by "delete_volume" :: held 1.533s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1" returned: 0 in 0.659s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0687d0-d1a7-46e2-bff8-001802d80c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149f551c-538f-410e-a124-cde117bb39d1', 'volume_size': 2}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3dc7f4-d20f-45da-8dba-298fd7bae287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:08 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Volume volume-149f551c-538f-410e-a124-cde117bb39d1 (149f551c-538f-410e-a124-cde117bb39d1): created successfully Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3dc7f4-d20f-45da-8dba-298fd7bae287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Flow 'volume_create_manager' (04eb7b84-adf8-45f8-ac67-68a736ec157d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:08 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fc233c12-6f61-4828-9b65-132336711750 tempest-VolumesCloneNegativeTest-1319838370 None] Created volume successfully. Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Created reservations ['de6e58de-bbbe-487a-a1ba-45c8f47f66a6'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:08 devstack cinder-volume[86459]: WARNING cinder.quota [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-895201458 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-895201458, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:25:08 devstack cinder-volume[86459]: WARNING cinder.quota [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-895201458 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-895201458, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Created reservations ['b6aebe86-a7e7-4d69-bc3e-f12c18248183', '3257eacc-88e5-4a6c-bdde-84c0b7b774a8', 'bc59d9ea-0979-49f4-9df6-4d80d04d6aaf', 'e33e975e-1e27-408f-afcd-78eb2510c74e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:08 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:08 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Acquiring lock "cinder-149f551c-538f-410e-a124-cde117bb39d1-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Lock "cinder-149f551c-538f-410e-a124-cde117bb39d1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Acquiring lock "cinder-quobyte-149f551c-538f-410e-a124-cde117bb39d1" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Lock "cinder-quobyte-149f551c-538f-410e-a124-cde117bb39d1" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0f4d44-23bb-4d80-96c1-582f34f30d1e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:09 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 Jul 05 17:25:09 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Flow 'volume_create_manager' (bec9aec5-21ea-4d08-b8bf-4ae6bb939cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740510f1-51bc-4745-8b0a-239f793fe38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740510f1-51bc-4745-8b0a-239f793fe38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004906329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50286d55-0e3f-4689-b415-5440452c1621,host='devstack@QuobyteHD#QuobyteHD',id=7bf10790-f1ea-47cd-9d4e-371bbe71858e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1759f0ad48944d6083badc42c90de7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:09Z,use_quota=True,user_id='cf9cfb47d5794f589ad31100f9dbb3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cd9661-ff02-458d-a39f-1b7b971a67d7),volume_type_id=d7cd9661-ff02-458d-a39f-1b7b971a67d7)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd92f7a-1029-4169-af19-b3692ae6295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd92f7a-1029-4169-af19-b3692ae6295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13be1f7a-fc7b-4abc-879a-eb3387131cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13be1f7a-fc7b-4abc-879a-eb3387131cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf10790-f1ea-47cd-9d4e-371bbe71858e', 'volume_name': 'volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe45f7c-258d-4ec2-9819-99c8a4fc8715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe45f7c-258d-4ec2-9819-99c8a4fc8715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a82516-2051-46b2-b4bb-e312070e66b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:09 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Volume 7bf10790-f1ea-47cd-9d4e-371bbe71858e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e', 'volume_size': 1} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=50286d55-0e3f-4689-b415-5440452c1621,created_at=2026-07-05T15:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004906329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50286d55-0e3f-4689-b415-5440452c1621,host='devstack@QuobyteHD#QuobyteHD',id=7bf10790-f1ea-47cd-9d4e-371bbe71858e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1759f0ad48944d6083badc42c90de7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:09Z,use_quota=True,user_id='cf9cfb47d5794f589ad31100f9dbb3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cd9661-ff02-458d-a39f-1b7b971a67d7),volume_type_id=d7cd9661-ff02-458d-a39f-1b7b971a67d7)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Creating volume 7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:09 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:09 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e 1073741824 Jul 05 17:25:09 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:09 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.770s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-89d2afb7-7b4c-4ad4-903a-3ef72a3ed57b tempest-GroupsV314Test-591156447 None] Delete group completed successfully. Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Acquiring lock "cinder-quobyte-ff759850-6b28-43cb-8aa2-6cc9553a8891" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Lock "cinder-quobyte-ff759850-6b28-43cb-8aa2-6cc9553a8891" acquired by "delete_volume" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0208a560-e7e3-4f1f-b67f-03484f7a438f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:09 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 Jul 05 17:25:09 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:09 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1" returned: 0 in 0.899s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:09 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1 Jul 05 17:25:09 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:10 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e 1073741824" returned: 0 in 0.930s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:10 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e Jul 05 17:25:10 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:10 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891" returned: 0 in 0.897s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:10 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891 Jul 05 17:25:10 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:10 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-149f551c-538f-410e-a124-cde117bb39d1" returned: 0 in 0.760s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Lock "cinder-quobyte-149f551c-538f-410e-a124-cde117bb39d1" released by "delete_volume" :: held 1.719s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Created reservations ['95715f91-d5db-47e1-affa-529fd58a860a', 'cfd0caed-6528-4401-9e06-315209503c22', '44b60f2a-2941-4aae-8f80-8a966113543c', '8f3bb142-7a30-4f50-bb38-fe79a1c6a616'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:10 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:10 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:11 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e" returned: 0 in 0.803s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a82516-2051-46b2-b4bb-e312070e66b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e062f2a0-b226-44f6-b9c1-6d72fbca4ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:11 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Volume volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e (7bf10790-f1ea-47cd-9d4e-371bbe71858e): created successfully Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e062f2a0-b226-44f6-b9c1-6d72fbca4ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Flow 'volume_create_manager' (bec9aec5-21ea-4d08-b8bf-4ae6bb939cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-1c11cedb-8ecb-44e0-a808-17b69e0a1b44 req-0e5505f7-5cda-4556-9b35-c6f83155017f tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-1c11cedb-8ecb-44e0-a808-17b69e0a1b44 req-0e5505f7-5cda-4556-9b35-c6f83155017f tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-40d2a6bc-bb10-4c5f-b34d-350360b3fdfa tempest-GroupSnapshotsTest-244745086 None] Created volume successfully. Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[47940c38-ff1d-4aa2-94f5-0f2098ceef51]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-1c11cedb-8ecb-44e0-a808-17b69e0a1b44 req-0e5505f7-5cda-4556-9b35-c6f83155017f tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:11 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff759850-6b28-43cb-8aa2-6cc9553a8891" returned: 0 in 0.789s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Lock "cinder-quobyte-ff759850-6b28-43cb-8aa2-6cc9553a8891" released by "delete_volume" :: held 1.756s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:11 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 Jul 05 17:25:11 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Created reservations ['0c2bbc1f-9ab5-4ab7-a8f2-58d234cc41ba'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Created reservations ['89222f25-d0a9-4dcf-87b9-581f0a6c6edc', '111d2754-dad8-47e6-bc5e-4217be2bd8c9', '439b1c16-8623-4b89-93af-a741ade2fea1', '3546c1fc-f5ae-4e21-8ead-1e99cc4a65cc'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:11 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.768s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Deleted volume successfully. Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e111cb6-e15b-4faa-9a35-b71bf833e30c tempest-VolumesCloneNegativeTest-1319838370 None] Lock "cinder-149f551c-538f-410e-a124-cde117bb39d1-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:11 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:11 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:12 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-1c11cedb-8ecb-44e0-a808-17b69e0a1b44 req-0e5505f7-5cda-4556-9b35-c6f83155017f tempest-AttachVolumeNegativeTest-1919246832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5" returned: 0 in 1.001s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-1c11cedb-8ecb-44e0-a808-17b69e0a1b44 req-0e5505f7-5cda-4556-9b35-c6f83155017f tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.028s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-1c11cedb-8ecb-44e0-a808-17b69e0a1b44 req-0e5505f7-5cda-4556-9b35-c6f83155017f tempest-AttachVolumeNegativeTest-1919246832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39726af0-4d0a-4477-9ea2-3bbbc9134f5e', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:25:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] GroupSnapshot d7498aeb-a859-4646-8a20-fbbed1bcb3e7: creating. Jul 05 17:25:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-1c11cedb-8ecb-44e0-a808-17b69e0a1b44 req-0e5505f7-5cda-4556-9b35-c6f83155017f tempest-AttachVolumeNegativeTest-1919246832 None] attachment_update completed successfully. Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Group snapshot d7498aeb-a859-4646-8a20-fbbed1bcb3e7: creating. {{(pid=86459) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Creating offline snapshot 04284b63-e3bc-4693-9e9e-594b2bc79a81 of volume 7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[699c08f9-7f7d-4e84-8f46-d9d473c9f007]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:12 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.868s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:12 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d620b546-96b6-416d-98b0-e6b99629f3f8 tempest-GroupsV314Test-591156447 None] Delete group completed successfully. Jul 05 17:25:12 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e Jul 05 17:25:12 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:13 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e" returned: 0 in 1.063s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:13 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 1G Jul 05 17:25:13 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:14 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 1G" returned: 0 in 0.963s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:14 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 Jul 05 17:25:14 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Flow 'volume_create_manager' (1d82f3e8-7078-4801-9a86-3759a68e99fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334cfb58-174c-47a7-ae54-bacb52ecf136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334cfb58-174c-47a7-ae54-bacb52ecf136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-826731598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9aa56de-7530-47f6-89a8-7b158aebc38c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fad768d9cf6e45d6a0108675328aa5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:15Z,use_quota=True,user_id='76dff0a4ca96472ba02eb909d81d1413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699ceb08-340e-48d4-8331-c5db9fccfe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699ceb08-340e-48d4-8331-c5db9fccfe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3edb184-f79b-4817-9672-8264d226533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3edb184-f79b-4817-9672-8264d226533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9aa56de-7530-47f6-89a8-7b158aebc38c', 'volume_name': 'volume-a9aa56de-7530-47f6-89a8-7b158aebc38c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97df3b1-cc94-446b-993e-8418b13fd0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97df3b1-cc94-446b-993e-8418b13fd0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4780b98-cff8-4784-b02e-557c44f1d592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:15 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Volume a9aa56de-7530-47f6-89a8-7b158aebc38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9aa56de-7530-47f6-89a8-7b158aebc38c', 'volume_size': 1} Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:15 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81" returned: 0 in 0.788s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:15 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:25:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:15 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 Jul 05 17:25:15 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:16 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81" returned: 0 in 0.666s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:16 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.info Jul 05 17:25:16 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:16 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.info" returned: 0 in 0.669s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:16 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:25:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:16 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.info Jul 05 17:25:16 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:17 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.info" returned: 0 in 0.656s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.918s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.278s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-826731598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9aa56de-7530-47f6-89a8-7b158aebc38c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fad768d9cf6e45d6a0108675328aa5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:15Z,use_quota=True,user_id='76dff0a4ca96472ba02eb909d81d1413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Creating volume a9aa56de-7530-47f6-89a8-7b158aebc38c {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:17 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:17 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c 1073741824 Jul 05 17:25:17 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-bfad3c96-43a2-4856-b603-dd16555ded00 tempest-GroupSnapshotsTest-244745086 None] group_snapshot d7498aeb-a859-4646-8a20-fbbed1bcb3e7: created successfully Jul 05 17:25:18 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c 1073741824" returned: 0 in 0.993s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:18 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c Jul 05 17:25:18 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Flow 'volume_create_manager' (c6b6470d-12fd-41ce-842c-465d83498161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42eefeb8-f6a8-4280-a391-a78a0d4b9901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42eefeb8-f6a8-4280-a391-a78a0d4b9901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-264398619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7909e75c-b133-4b0a-abcb-4669dfee3778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7589309b0d84317904eec0e27835f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:19Z,use_quota=True,user_id='f449dabbcda048bfb4c3022858c98243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374770b9-de27-47ce-8ebd-7e8c3373a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374770b9-de27-47ce-8ebd-7e8c3373a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dae33a-12d3-429d-94bf-286972fc8682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dae33a-12d3-429d-94bf-286972fc8682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7909e75c-b133-4b0a-abcb-4669dfee3778', 'volume_name': 'volume-7909e75c-b133-4b0a-abcb-4669dfee3778', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd372003-90ee-4f20-acc3-b9649d99e26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd372003-90ee-4f20-acc3-b9649d99e26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3503f82f-9fc2-4b8d-8c30-0825ae03223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:18 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Volume 7909e75c-b133-4b0a-abcb-4669dfee3778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7909e75c-b133-4b0a-abcb-4669dfee3778', 'volume_size': 1} Jul 05 17:25:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:19 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c" returned: 0 in 0.712s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-264398619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7909e75c-b133-4b0a-abcb-4669dfee3778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7589309b0d84317904eec0e27835f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:19Z,use_quota=True,user_id='f449dabbcda048bfb4c3022858c98243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Creating volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:19 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:19 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 1073741824 Jul 05 17:25:19 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4780b98-cff8-4784-b02e-557c44f1d592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9aa56de-7530-47f6-89a8-7b158aebc38c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f352a0d-17d6-4131-8ebd-e2b7c655fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:19 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Volume volume-a9aa56de-7530-47f6-89a8-7b158aebc38c (a9aa56de-7530-47f6-89a8-7b158aebc38c): created successfully Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f352a0d-17d6-4131-8ebd-e2b7c655fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Flow 'volume_create_manager' (1d82f3e8-7078-4801-9a86-3759a68e99fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-7df40a11-f1ab-49ff-958c-1f7b0e2bc989 req-e9fb1345-088c-450d-adf9-b647998c0124 tempest-AttachVolumeNegativeTest-1919246832 None] Terminate volume connection completed successfully. Jul 05 17:25:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-7df40a11-f1ab-49ff-958c-1f7b0e2bc989 req-e9fb1345-088c-450d-adf9-b647998c0124 tempest-AttachVolumeNegativeTest-1919246832 None] Deleting attachment 39726af0-4d0a-4477-9ea2-3bbbc9134f5e. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:25:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-104cea92-4901-4cfb-a083-78fb11b71224 tempest-VolumesListTestJSON-143461670 None] Created volume successfully. Jul 05 17:25:20 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 1073741824" returned: 0 in 0.910s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:20 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 Jul 05 17:25:20 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Flow 'volume_create_manager' (3541b6a6-ccad-42e9-a1d9-28256a7bcae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b53add6-ed4c-4066-8e3a-cee211d6c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b53add6-ed4c-4066-8e3a-cee211d6c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1893790080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ba8dc5-3aa6-4dce-af4d-a732a514cc4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fad768d9cf6e45d6a0108675328aa5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:20Z,use_quota=True,user_id='76dff0a4ca96472ba02eb909d81d1413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809d93cb-237e-4292-a16a-d1eded2728d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809d93cb-237e-4292-a16a-d1eded2728d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd180121-b7dd-4dce-9444-a61dc5c281b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd180121-b7dd-4dce-9444-a61dc5c281b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ba8dc5-3aa6-4dce-af4d-a732a514cc4b', 'volume_name': 'volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768aa60d-b06e-411d-9ad6-fd0516beffa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768aa60d-b06e-411d-9ad6-fd0516beffa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd5371f-41a4-4884-8ae1-1c12b96ceff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:20 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Volume 42ba8dc5-3aa6-4dce-af4d-a732a514cc4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b', 'volume_size': 1} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:20 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778" returned: 0 in 0.668s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.521s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-04284b63-e3bc-4693-9e9e-594b2bc79a81-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3503f82f-9fc2-4b8d-8c30-0825ae03223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7909e75c-b133-4b0a-abcb-4669dfee3778', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b72ca9-4163-4c58-ba86-5a1de26d81f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-04284b63-e3bc-4693-9e9e-594b2bc79a81-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Creating volume da983a2c-c23c-4f1a-9d44-7bbf38f4ceba from snapshot 04284b63-e3bc-4693-9e9e-594b2bc79a81 {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:20 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Volume volume-7909e75c-b133-4b0a-abcb-4669dfee3778 (7909e75c-b133-4b0a-abcb-4669dfee3778): created successfully Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b72ca9-4163-4c58-ba86-5a1de26d81f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Flow 'volume_create_manager' (c6b6470d-12fd-41ce-842c-465d83498161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] snapshot: 04284b63-e3bc-4693-9e9e-594b2bc79a81, volume: da983a2c-c23c-4f1a-9d44-7bbf38f4ceba, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7a9576bb-963f-432f-891f-afa72c727c51 tempest-SnapshotsActionsTest-1392168243 None] Created volume successfully. Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec35290f-2c36-414e-9271-3fe818e84cab]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:21 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 Jul 05 17:25:21 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:21 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81" returned: 0 in 0.774s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:25:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:25:21 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e1356c-8bec-4b23-a7e1-3448b530ba19]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:21 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e Jul 05 17:25:21 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:22 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e" returned: 0 in 0.799s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:22 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:25:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:22 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba Jul 05 17:25:22 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:28 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" returned: 0 in 5.711s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b3b857-0674-47bc-9e93-5d72db3e3ffd]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:28 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e Jul 05 17:25:28 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:29 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e" returned: 0 in 0.936s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:25:29 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Converted 1024.00 MB image at 179.27 MB/s Jul 05 17:25:29 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:29 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba Jul 05 17:25:29 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:29 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" returned: 0 in 0.636s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" released by "_copy_volume_from_snapshot" :: held 8.962s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-04284b63-e3bc-4693-9e9e-594b2bc79a81-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" released by "_create_volume_from_snapshot" :: held 9.008s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.039s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.545s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1893790080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ba8dc5-3aa6-4dce-af4d-a732a514cc4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fad768d9cf6e45d6a0108675328aa5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:20Z,use_quota=True,user_id='76dff0a4ca96472ba02eb909d81d1413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Creating volume 42ba8dc5-3aa6-4dce-af4d-a732a514cc4b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:29 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=94,cinder:UPDATE=96,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:25:29 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b 1073741824 Jul 05 17:25:29 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:29 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=96,cinder:SELECT=73,cinder:DELETE=9,cinder:INSERT=22 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:25:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-92afc498-0d51-4571-9dde-46d27ab7715e tempest-GroupSnapshotsTest-244745086 None] Create group from source-snapshot-d7498aeb-a859-4646-8a20-fbbed1bcb3e7 completed successfully. Jul 05 17:25:30 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b 1073741824" returned: 0 in 0.814s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:30 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b Jul 05 17:25:30 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5457ad9e-f5cb-45e6-acea-ed82d47ff517]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:31 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b" returned: 0 in 0.679s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.365s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd5371f-41a4-4884-8ae1-1c12b96ceff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861879f9-4b8f-49bc-9072-338dff367aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Creating offline snapshot f7412510-d7c5-4265-b0fe-0e31c7d94364 of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:25:31 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba Jul 05 17:25:31 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:31 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Volume volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b (42ba8dc5-3aa6-4dce-af4d-a732a514cc4b): created successfully Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861879f9-4b8f-49bc-9072-338dff367aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Flow 'volume_create_manager' (3541b6a6-ccad-42e9-a1d9-28256a7bcae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb5af32-9ec1-42d3-a59f-93b488507cf5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d383a2a4-51cc-479a-b17f-1c7fd5022947 tempest-VolumesListTestJSON-143461670 None] Created volume successfully. Jul 05 17:25:31 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 Jul 05 17:25:31 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:32 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" returned: 0 in 0.903s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:32 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba Jul 05 17:25:32 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:32 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778" returned: 0 in 0.893s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:32 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 1G Jul 05 17:25:32 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:33 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" returned: 0 in 0.815s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-da983a2c-c23c-4f1a-9d44-7bbf38f4ceba" released by "delete_volume" :: held 1.778s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Flow 'volume_create_manager' (85e2fe4c-d1a8-4ae0-abd3-798f4308ca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f983717d-904a-426e-ab10-f968a66dd22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Created reservations ['1b00b9c0-b05a-4be6-a432-ee44a618e96d'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f983717d-904a-426e-ab10-f968a66dd22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1435386271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5e4ec9-861b-4cba-8d94-113922f92025,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fad768d9cf6e45d6a0108675328aa5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:33Z,use_quota=True,user_id='76dff0a4ca96472ba02eb909d81d1413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff4c3ba-7676-445b-ae34-50bd3b462aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff4c3ba-7676-445b-ae34-50bd3b462aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07d9b86-4516-4611-8c9c-0d236f4322b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07d9b86-4516-4611-8c9c-0d236f4322b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5e4ec9-861b-4cba-8d94-113922f92025', 'volume_name': 'volume-ff5e4ec9-861b-4cba-8d94-113922f92025', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a227951c-5f0f-4c70-a2e3-76536aefbe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a227951c-5f0f-4c70-a2e3-76536aefbe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e685ada4-375b-4401-898f-df79533a4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:33 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Volume ff5e4ec9-861b-4cba-8d94-113922f92025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5e4ec9-861b-4cba-8d94-113922f92025', 'volume_size': 1} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:33 devstack cinder-volume[86459]: WARNING cinder.quota [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-99998809 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-99998809, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:25:33 devstack cinder-volume[86459]: WARNING cinder.quota [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-99998809 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-99998809, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Created reservations ['06590efd-a6f5-4a68-8cad-66c1ed014c06', 'c3a1331a-36b3-4c7e-be1f-a4d4881cec3f', '4a5c916e-802f-40d3-bdb6-f22b78e2563b', '2217cf8e-c597-4c77-b97c-d20dc276ec68'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:33 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 1G" returned: 0 in 1.006s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:33 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:33 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:33 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:25:33 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:33 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] group_snapshot d7498aeb-a859-4646-8a20-fbbed1bcb3e7: deleting Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] group_snapshot d7498aeb-a859-4646-8a20-fbbed1bcb3e7: deleting {{(pid=86459) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-7bf10790-f1ea-47cd-9d4e-371bbe71858e" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-7bf10790-f1ea-47cd-9d4e-371bbe71858e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-04284b63-e3bc-4693-9e9e-594b2bc79a81" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-04284b63-e3bc-4693-9e9e-594b2bc79a81" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Deleting offline snapshot 04284b63-e3bc-4693-9e9e-594b2bc79a81 of volume 7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] snapshot_file for this snap is: volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8145e-c707-4fa8-b051-3a7658243acb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:34 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.773s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a1e45e01-e44b-494d-b3a6-31284b2210e8 tempest-GroupSnapshotsTest-244745086 None] Delete group completed successfully. Jul 05 17:25:34 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 Jul 05 17:25:34 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:34 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.857s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:34 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 is being set with open permissions: ugo+rw Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:34 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:25:34 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:34 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.712s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:34 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81" returned: 0 in 0.920s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f98d54-4800-4d20-87e7-f5c3b6f37400]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:35 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.info Jul 05 17:25:35 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:35 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e Jul 05 17:25:35 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:35 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.info" returned: 0 in 0.683s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:35 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.info is being set with open permissions: ugo+rw Jul 05 17:25:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:35 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.info Jul 05 17:25:35 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:35 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e" returned: 0 in 0.779s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:35 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 Jul 05 17:25:35 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:36 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.info" returned: 0 in 0.668s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.980s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.191s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1435386271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5e4ec9-861b-4cba-8d94-113922f92025,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fad768d9cf6e45d6a0108675328aa5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:33Z,use_quota=True,user_id='76dff0a4ca96472ba02eb909d81d1413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Creating volume ff5e4ec9-861b-4cba-8d94-113922f92025 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:36 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:36 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 1073741824 Jul 05 17:25:36 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e3a480c2-7fce-4ef0-aea0-26f6e67dd072 tempest-SnapshotsActionsTest-1392168243 None] Create snapshot completed successfully Jul 05 17:25:36 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81" returned: 0 in 0.766s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:36 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81 Jul 05 17:25:36 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:37 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e.04284b63-e3bc-4693-9e9e-594b2bc79a81" returned: 0 in 0.729s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-04284b63-e3bc-4693-9e9e-594b2bc79a81" released by "_delete_snapshot" :: held 3.333s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-7bf10790-f1ea-47cd-9d4e-371bbe71858e" released by "delete_snapshot" :: held 3.375s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:37 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 1073741824" returned: 0 in 0.936s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:37 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 Jul 05 17:25:37 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:37 devstack cinder-volume[86459]: WARNING cinder.quota [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-99998809 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-99998809, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:25:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:37 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] Created reservations ['6c8edbee-0357-4911-9757-91c7ec9231f6', '2c69c99b-6d16-43ff-9adf-eeb8040624d0', '90630cf5-0c1f-47ad-b955-dd55d299c7c0', 'aaf21aaa-b6d7-4f47-8b2e-2a345c62772f'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-af6d0553-cb02-4d60-9fb3-8f8df245b5d0 tempest-GroupSnapshotsTest-244745086 None] group_snapshot d7498aeb-a859-4646-8a20-fbbed1bcb3e7: deleted successfully Jul 05 17:25:38 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025" returned: 0 in 0.631s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.588s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e685ada4-375b-4401-898f-df79533a4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5e4ec9-861b-4cba-8d94-113922f92025', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c94935-27e1-4e0f-80b0-3282682af342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Creating offline snapshot 90dfcc95-745b-4b83-9153-fea1e21eddcf of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f997fbc-c07f-4632-90f8-6f6c8ed70c8b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:38 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Volume volume-ff5e4ec9-861b-4cba-8d94-113922f92025 (ff5e4ec9-861b-4cba-8d94-113922f92025): created successfully Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c94935-27e1-4e0f-80b0-3282682af342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Flow 'volume_create_manager' (85e2fe4c-d1a8-4ae0-abd3-798f4308ca71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3dba03aa-964d-4aad-8d2e-5fb64210152f tempest-VolumesListTestJSON-143461670 None] Created volume successfully. Jul 05 17:25:38 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:25:38 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-7bf10790-f1ea-47cd-9d4e-371bbe71858e" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-7bf10790-f1ea-47cd-9d4e-371bbe71858e" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97506a-13d4-4010-8c71-77288619902b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:38 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e Jul 05 17:25:38 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:38 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.872s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:39 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf 1G Jul 05 17:25:39 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:39 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e" returned: 0 in 0.996s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:39 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e Jul 05 17:25:39 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:40 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf 1G" returned: 0 in 1.041s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:40 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf Jul 05 17:25:40 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:40 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7bf10790-f1ea-47cd-9d4e-371bbe71858e" returned: 0 in 1.113s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-7bf10790-f1ea-47cd-9d4e-371bbe71858e" released by "delete_volume" :: held 2.196s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:40 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Created reservations ['ec253eea-b342-42f6-a7a8-8721adb5d01b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:40 devstack cinder-volume[86459]: WARNING cinder.db.api [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-99998809'] Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Created reservations ['33563267-9425-438c-9400-34bc646da9ae', '812a3498-f137-4055-b2ac-7990e7e9d2fd', '88f2535a-a850-4bde-af95-e35232f2800b', '3fa72ad8-ac7c-451e-8080-e3046e054e5d'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:41 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf" returned: 0 in 1.109s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:41 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf is being set with open permissions: ugo+rw Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:41 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf Jul 05 17:25:41 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:41 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:41 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "cinder-ff5e4ec9-861b-4cba-8d94-113922f92025-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Lock "cinder-ff5e4ec9-861b-4cba-8d94-113922f92025-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "cinder-quobyte-ff5e4ec9-861b-4cba-8d94-113922f92025" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Lock "cinder-quobyte-ff5e4ec9-861b-4cba-8d94-113922f92025" acquired by "delete_volume" :: waited 0.043s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8778b68f-e946-4b9f-bcd7-990ca4b3fbb4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:41 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 Jul 05 17:25:41 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ff1ca9a7-0d31-44bc-b165-82d3ba06755a tempest-GroupSnapshotsTest-244745086 None] Group tempest-GroupSnapshotsTest-Group-593350907: creating Jul 05 17:25:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ff1ca9a7-0d31-44bc-b165-82d3ba06755a tempest-GroupSnapshotsTest-244745086 None] Group tempest-GroupSnapshotsTest-Group-593350907: created successfully Jul 05 17:25:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ff1ca9a7-0d31-44bc-b165-82d3ba06755a tempest-GroupSnapshotsTest-244745086 None] Create group completed successfully. Jul 05 17:25:42 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf" returned: 0 in 1.250s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:42 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.226s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.400s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e78f590e-b1d0-453b-8154-8c4bf4d9124b tempest-GroupSnapshotsTest-244745086 None] Delete group completed successfully. Jul 05 17:25:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-abaafae4-0207-491a-a30c-63866314234c tempest-SnapshotsActionsTest-1392168243 None] Create snapshot completed successfully Jul 05 17:25:42 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025" returned: 0 in 1.103s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-90dfcc95-745b-4b83-9153-fea1e21eddcf-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:42 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025 Jul 05 17:25:42 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-90dfcc95-745b-4b83-9153-fea1e21eddcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-quobyte-90dfcc95-745b-4b83-9153-fea1e21eddcf" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-90dfcc95-745b-4b83-9153-fea1e21eddcf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Deleting offline snapshot 90dfcc95-745b-4b83-9153-fea1e21eddcf of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] snapshot_file for this snap is: volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f61560-14f3-4626-987d-15b594196ada]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:43 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf Jul 05 17:25:43 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:43 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5e4ec9-861b-4cba-8d94-113922f92025" returned: 0 in 0.785s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Lock "cinder-quobyte-ff5e4ec9-861b-4cba-8d94-113922f92025" released by "delete_volume" :: held 1.985s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Flow 'volume_create_manager' (dcfea7b5-ba1e-4714-84b1-0b670c40f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99264c2-3c11-426e-b4a4-ad5abf422a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99264c2-3c11-426e-b4a4-ad5abf422a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1877160900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71a78434-87cc-4ecb-b3ff-b81b3872496f,host='devstack@QuobyteHD#QuobyteHD',id=d6ae6366-bedc-4a4e-afbc-8fd521146155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1759f0ad48944d6083badc42c90de7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:44Z,use_quota=True,user_id='cf9cfb47d5794f589ad31100f9dbb3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(177aa97a-4289-4728-921d-4bb7b7cfcbf3),volume_type_id=177aa97a-4289-4728-921d-4bb7b7cfcbf3)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2b5ab2-3fcc-45e3-be74-49b66c3ccae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2b5ab2-3fcc-45e3-be74-49b66c3ccae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b29234-6ff1-4f20-bb58-fa6825da3625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b29234-6ff1-4f20-bb58-fa6825da3625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ae6366-bedc-4a4e-afbc-8fd521146155', 'volume_name': 'volume-d6ae6366-bedc-4a4e-afbc-8fd521146155', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fac41a-b18c-4ad3-9281-dbd60402de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fac41a-b18c-4ad3-9281-dbd60402de1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7b3750-cffe-431f-910e-78f71aee6c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:43 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Volume d6ae6366-bedc-4a4e-afbc-8fd521146155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ae6366-bedc-4a4e-afbc-8fd521146155', 'volume_size': 1} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71a78434-87cc-4ecb-b3ff-b81b3872496f,created_at=2026-07-05T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1877160900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71a78434-87cc-4ecb-b3ff-b81b3872496f,host='devstack@QuobyteHD#QuobyteHD',id=d6ae6366-bedc-4a4e-afbc-8fd521146155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1759f0ad48944d6083badc42c90de7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:44Z,use_quota=True,user_id='cf9cfb47d5794f589ad31100f9dbb3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(177aa97a-4289-4728-921d-4bb7b7cfcbf3),volume_type_id=177aa97a-4289-4728-921d-4bb7b7cfcbf3)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Creating volume d6ae6366-bedc-4a4e-afbc-8fd521146155 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:43 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Created reservations ['5ca236b6-0db8-4a30-bfc1-3e1c36b731d3', '09be5e36-0a69-4602-af1a-4e9eb7e17b22', '6654a699-d3d7-4b1e-8c77-3368b720d251', 'bb2d6be6-e8ed-4bb6-8f4e-08653ee4ff28'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:43 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 1073741824 Jul 05 17:25:43 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:43 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf" returned: 0 in 0.931s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[175b0ca5-62be-4bd6-b0a3-beb4176100fe]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:44 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:44 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:44 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:25:44 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:44 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.669s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Deleted volume successfully. Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5727f8f9-98a3-48d8-84bf-5f6c3f96f074 tempest-VolumesListTestJSON-143461670 None] Lock "cinder-ff5e4ec9-861b-4cba-8d94-113922f92025-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:44 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 1073741824" returned: 0 in 0.920s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:44 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 Jul 05 17:25:44 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:44 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.860s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:44 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf Jul 05 17:25:44 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "cinder-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Lock "cinder-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "cinder-quobyte-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Lock "cinder-quobyte-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1ff661-dd18-4875-9b63-8223712ad004]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:45 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b Jul 05 17:25:45 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:45 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155" returned: 0 in 0.729s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7b3750-cffe-431f-910e-78f71aee6c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ae6366-bedc-4a4e-afbc-8fd521146155', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d0e832-5066-4c0d-8ff7-0a2cc40dcbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:45 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Volume volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 (d6ae6366-bedc-4a4e-afbc-8fd521146155): created successfully Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d0e832-5066-4c0d-8ff7-0a2cc40dcbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Flow 'volume_create_manager' (dcfea7b5-ba1e-4714-84b1-0b670c40f325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:45 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a7997255-a11c-469d-9b03-77b92d292395 tempest-GroupSnapshotsTest-244745086 None] Created volume successfully. Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf" returned: 0 in 0.868s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:45 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:45 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf Jul 05 17:25:45 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:46 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b" returned: 0 in 1.037s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:46 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b Jul 05 17:25:46 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:46 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.90dfcc95-745b-4b83-9153-fea1e21eddcf" returned: 0 in 1.108s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-90dfcc95-745b-4b83-9153-fea1e21eddcf" released by "_delete_snapshot" :: held 3.919s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" released by "delete_snapshot" :: held 3.941s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:47 devstack cinder-volume[86459]: WARNING cinder.quota [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Created reservations ['b722e8f9-f3c7-48c6-90f5-787de95b6180', 'b9197129-dff2-4def-af4a-8f46a718f294', '7b6f7da2-3526-4089-946b-e9cd35a98cd7', 'd3c58624-f502-4c2a-b894-6efc49b4dea5'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:47 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b" returned: 0 in 0.864s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Lock "cinder-quobyte-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b" released by "delete_volume" :: held 1.957s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Delete snapshot completed successfully. Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-682a9677-e75c-408c-bdfa-d805df0061fe tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-90dfcc95-745b-4b83-9153-fea1e21eddcf-delete_snapshot" released by "delete_snapshot" :: held 4.206s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Flow 'volume_create_manager' (6789704a-ebbe-4405-bce2-b3954776c9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2d064d-4456-4667-8541-04d71d07206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2d064d-4456-4667-8541-04d71d07206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-210828355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71a78434-87cc-4ecb-b3ff-b81b3872496f,host='devstack@QuobyteHD#QuobyteHD',id=a30e775d-40e8-40d1-a10b-11cc745dc65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1759f0ad48944d6083badc42c90de7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:47Z,use_quota=True,user_id='cf9cfb47d5794f589ad31100f9dbb3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(177aa97a-4289-4728-921d-4bb7b7cfcbf3),volume_type_id=177aa97a-4289-4728-921d-4bb7b7cfcbf3)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469d3396-e22f-4726-97f0-d7be97f0a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469d3396-e22f-4726-97f0-d7be97f0a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562a2b20-bbe1-49c8-bd3f-4722701e9a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562a2b20-bbe1-49c8-bd3f-4722701e9a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30e775d-40e8-40d1-a10b-11cc745dc65d', 'volume_name': 'volume-a30e775d-40e8-40d1-a10b-11cc745dc65d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7832d32-9f57-4333-bc34-6c87541b3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7832d32-9f57-4333-bc34-6c87541b3a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cb8b4c-05bb-4392-b6ac-2a0ba65a4365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:47 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Volume a30e775d-40e8-40d1-a10b-11cc745dc65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30e775d-40e8-40d1-a10b-11cc745dc65d', 'volume_size': 1} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71a78434-87cc-4ecb-b3ff-b81b3872496f,created_at=2026-07-05T15:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-210828355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71a78434-87cc-4ecb-b3ff-b81b3872496f,host='devstack@QuobyteHD#QuobyteHD',id=a30e775d-40e8-40d1-a10b-11cc745dc65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1759f0ad48944d6083badc42c90de7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:47Z,use_quota=True,user_id='cf9cfb47d5794f589ad31100f9dbb3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(177aa97a-4289-4728-921d-4bb7b7cfcbf3),volume_type_id=177aa97a-4289-4728-921d-4bb7b7cfcbf3)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Creating volume a30e775d-40e8-40d1-a10b-11cc745dc65d {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:47 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:47 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d 1073741824 Jul 05 17:25:47 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Created reservations ['64efafdf-f23e-4997-b757-ae08431418bf', 'b0cc392e-84a1-4f9a-8bc5-51b6d071071e', '767f7f65-f895-40f3-821d-3d44c75bc656', '266981b3-c5e0-4a6a-b77c-93c5d897d13e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:47 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:47 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:48 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.776s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Deleted volume successfully. Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0f95479d-9ee2-4c7d-860a-63bf9b6d4b74 tempest-VolumesListTestJSON-143461670 None] Lock "cinder-42ba8dc5-3aa6-4dce-af4d-a732a514cc4b-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:48 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d 1073741824" returned: 0 in 1.057s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:48 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d Jul 05 17:25:48 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Acquiring lock "cinder-a9aa56de-7530-47f6-89a8-7b158aebc38c-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Lock "cinder-a9aa56de-7530-47f6-89a8-7b158aebc38c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Acquiring lock "cinder-quobyte-a9aa56de-7530-47f6-89a8-7b158aebc38c" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Lock "cinder-quobyte-a9aa56de-7530-47f6-89a8-7b158aebc38c" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[28097388-450f-48aa-b80a-764626f6072e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:48 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c Jul 05 17:25:48 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:49 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d" returned: 0 in 0.726s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.516s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Creating offline snapshot 94f6fe93-79f7-416c-9c7b-478d9f154df4 of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cb8b4c-05bb-4392-b6ac-2a0ba65a4365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30e775d-40e8-40d1-a10b-11cc745dc65d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0ac67f-1de2-4b63-a865-359238ca36a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562348b-aecc-48fd-9c01-ed708b7caf3b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Volume volume-a30e775d-40e8-40d1-a10b-11cc745dc65d (a30e775d-40e8-40d1-a10b-11cc745dc65d): created successfully Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0ac67f-1de2-4b63-a865-359238ca36a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Flow 'volume_create_manager' (6789704a-ebbe-4405-bce2-b3954776c9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f46e2875-9796-40d0-bc23-727701adce4d tempest-GroupSnapshotsTest-244745086 None] Created volume successfully. Jul 05 17:25:49 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:25:49 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:49 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c" returned: 0 in 0.964s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:49 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c Jul 05 17:25:49 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a7167ca4-b5a5-4ad2-9ecb-1189f1b0d9d5 tempest-GroupSnapshotsTest-244745086 None] Update group completed successfully. Jul 05 17:25:50 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 1.050s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:50 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 1G Jul 05 17:25:50 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:50 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a9aa56de-7530-47f6-89a8-7b158aebc38c" returned: 0 in 0.929s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Lock "cinder-quobyte-a9aa56de-7530-47f6-89a8-7b158aebc38c" released by "delete_volume" :: held 1.972s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Created reservations ['c89db5ed-bcb1-4905-b8bf-32aae6a24628', '22c5e702-4724-4619-b8b2-31cc8be6fd1a', '5b583aff-7657-4225-bd3f-e0ba51fdd98b', '1f1b66be-214a-403c-ad16-de1c148fb079'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:50 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:50 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:50 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:25:50 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2f280e92-3e7a-479e-a708-5cddced5890b tempest-GroupSnapshotsTest-244745086 None] Update group completed successfully. Jul 05 17:25:51 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.034s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Deleted volume successfully. Jul 05 17:25:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b292d8e-99ce-49b7-879c-32a31ca252cc tempest-VolumesListTestJSON-143461670 None] Lock "cinder-a9aa56de-7530-47f6-89a8-7b158aebc38c-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:52 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 1G" returned: 0 in 1.859s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:52 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 Jul 05 17:25:52 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:52 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.462s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:52 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:25:52 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:25:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:25:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:25:52 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e7aac5ac-7572-4b62-a230-cff9822f4e2e tempest-GroupSnapshotsTest-244745086 None] Update group completed successfully. Jul 05 17:25:53 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4" returned: 0 in 1.087s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:53 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 is being set with open permissions: ugo+rw Jul 05 17:25:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:53 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 Jul 05 17:25:53 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:53 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-733728db-6ace-42dc-a0d7-ae46f07e1d84 tempest-GroupSnapshotsTest-244745086 None] Update group completed successfully. Jul 05 17:25:54 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4" returned: 0 in 0.890s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.081s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-35d0ee7c-f5ae-4ef6-863f-6ce80c88eddd tempest-SnapshotsActionsTest-1392168243 None] Create snapshot completed successfully Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Flow 'volume_create_manager' (16be802a-1ec1-49e1-9c6e-3db0431471c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b57350-4a11-4444-a6d0-58bd278f20d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b57350-4a11-4444-a6d0-58bd278f20d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1595504187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b98d17-84e7-4f40-906e-3e02b6ae28d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842c4f224d444b1fa8c484854f75a6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:55Z,use_quota=True,user_id='8e8be55be41943fbbb17b26ae2242e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f8e17a-a5df-472f-8eec-c239448214d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f8e17a-a5df-472f-8eec-c239448214d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b3dd6f-237e-4562-be02-d2d36c35fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b3dd6f-237e-4562-be02-d2d36c35fec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b98d17-84e7-4f40-906e-3e02b6ae28d8', 'volume_name': 'volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8089990a-460e-4dda-b875-fd0aafab5a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8089990a-460e-4dda-b875-fd0aafab5a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0de754d-04cb-4171-9b0c-d0ef1ff98e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:55 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Volume 40b98d17-84e7-4f40-906e-3e02b6ae28d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8', 'volume_size': 1} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1595504187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b98d17-84e7-4f40-906e-3e02b6ae28d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842c4f224d444b1fa8c484854f75a6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:25:55Z,use_quota=True,user_id='8e8be55be41943fbbb17b26ae2242e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Creating volume 40b98d17-84e7-4f40-906e-3e02b6ae28d8 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:25:55 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-94f6fe93-79f7-416c-9c7b-478d9f154df4-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:55 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 1073741824 Jul 05 17:25:55 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-94f6fe93-79f7-416c-9c7b-478d9f154df4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-quobyte-94f6fe93-79f7-416c-9c7b-478d9f154df4" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-94f6fe93-79f7-416c-9c7b-478d9f154df4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Deleting offline snapshot 94f6fe93-79f7-416c-9c7b-478d9f154df4 of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] snapshot_file for this snap is: volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[375a8967-3284-4eca-b5be-de738eb9cbc5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] GroupSnapshot c4cc892b-1fad-4531-9662-9300d5ef299d: creating. Jul 05 17:25:55 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 Jul 05 17:25:55 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Group snapshot c4cc892b-1fad-4531-9662-9300d5ef299d: creating. {{(pid=86459) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 17:25:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:25:56 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 1073741824" returned: 0 in 0.971s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:56 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4" returned: 0 in 0.897s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:56 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 Jul 05 17:25:56 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b02e81a-6972-40b6-ab33-79a84b8a8dd0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:56 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:25:56 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:56 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8" returned: 0 in 0.661s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.329s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0de754d-04cb-4171-9b0c-d0ef1ff98e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cd2ed7-113c-423a-8c4f-6b27bd7e46ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:25:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Creating offline snapshot 7087ea10-e085-405a-bba4-09d4d32c2404 of volume a30e775d-40e8-40d1-a10b-11cc745dc65d {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:25:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Volume volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 (40b98d17-84e7-4f40-906e-3e02b6ae28d8): created successfully Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cd2ed7-113c-423a-8c4f-6b27bd7e46ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Flow 'volume_create_manager' (16be802a-1ec1-49e1-9c6e-3db0431471c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aad83e5-d36f-4524-b6a6-81d0e4cf07da]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b22a7a58-69a7-4e69-a991-615fcee2dcba tempest-VolumesNegativeTest-537915217 None] Created volume successfully. Jul 05 17:25:57 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d Jul 05 17:25:57 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:57 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.888s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:57 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 Jul 05 17:25:57 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:57 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d" returned: 0 in 0.959s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:58 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 1G Jul 05 17:25:58 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:58 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4" returned: 0 in 0.958s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:58 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4 Jul 05 17:25:58 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:58 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 1G" returned: 0 in 0.975s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30e775d-40e8-40d1-a10b-11cc745dc65d -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:58 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.94f6fe93-79f7-416c-9c7b-478d9f154df4" returned: 0 in 0.800s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:58 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30e775d-40e8-40d1-a10b-11cc745dc65d -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 Jul 05 17:25:58 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-94f6fe93-79f7-416c-9c7b-478d9f154df4" released by "_delete_snapshot" :: held 3.664s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" released by "delete_snapshot" :: held 3.697s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:59 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Created reservations ['59ef7269-58d0-47eb-82cc-d9452a723dec', '562b4669-6b4d-4db0-addc-7731f98b2d4f', 'e9d6485f-28b6-4d8b-ada7-580475cdf874', '916552ca-f87c-4eac-ab44-ea0a3bc41573'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:25:59 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Delete snapshot completed successfully. Jul 05 17:25:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-715be1b2-19d3-49ca-b9f2-7405c7faffd9 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-94f6fe93-79f7-416c-9c7b-478d9f154df4-delete_snapshot" released by "delete_snapshot" :: held 3.884s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:25:59 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jul 05 17:25:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30e775d-40e8-40d1-a10b-11cc745dc65d -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404" returned: 0 in 0.779s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:25:59 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:25:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:25:59 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 Jul 05 17:25:59 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:25:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:00 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404" returned: 0 in 0.733s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:00 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.info Jul 05 17:26:00 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:01 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.info" returned: 0 in 0.671s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:01 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:01 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.info Jul 05 17:26:01 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:01 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.info" returned: 0 in 0.660s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.901s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Creating offline snapshot 8815bbe7-dfe7-4848-850e-0eae253833d8 of volume d6ae6366-bedc-4a4e-afbc-8fd521146155 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c93a0-e2b3-4fe5-928a-dd5d8bb9c3b4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:01 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 Jul 05 17:26:01 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:02 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155" returned: 0 in 0.764s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:02 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 1G Jul 05 17:26:02 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:03 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 1G" returned: 0 in 0.858s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:03 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 Jul 05 17:26:03 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:04 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8" returned: 0 in 0.831s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:04 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:26:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:04 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 Jul 05 17:26:04 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:05 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8" returned: 0 in 0.740s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:05 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.info Jul 05 17:26:05 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:05 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.info" returned: 0 in 0.671s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:05 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:26:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:05 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.info Jul 05 17:26:05 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:06 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.info" returned: 0 in 0.654s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.625s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.617s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Creating offline snapshot 3bae37ab-b66a-4866-be5f-9f2334b5b7a6 of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:26:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0104f33-c2df-4117-a608-21a9f230945c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-64a1a726-05df-4b06-9d9d-913ff36cfea5 tempest-GroupSnapshotsTest-244745086 None] group_snapshot c4cc892b-1fad-4531-9662-9300d5ef299d: created successfully Jul 05 17:26:06 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:26:06 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] group_snapshot c4cc892b-1fad-4531-9662-9300d5ef299d: deleting Jul 05 17:26:07 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.815s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] group_snapshot c4cc892b-1fad-4531-9662-9300d5ef299d: deleting {{(pid=86459) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 17:26:07 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 1G Jul 05 17:26:07 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-a30e775d-40e8-40d1-a10b-11cc745dc65d" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-a30e775d-40e8-40d1-a10b-11cc745dc65d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-7087ea10-e085-405a-bba4-09d4d32c2404" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-7087ea10-e085-405a-bba4-09d4d32c2404" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Deleting offline snapshot 7087ea10-e085-405a-bba4-09d4d32c2404 of volume a30e775d-40e8-40d1-a10b-11cc745dc65d {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] snapshot_file for this snap is: volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e9e369-f939-41ee-9228-5e09bf3432cb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:07 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 Jul 05 17:26:07 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:08 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 1G" returned: 0 in 0.919s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:08 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 Jul 05 17:26:08 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404" returned: 0 in 0.871s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30e775d-40e8-40d1-a10b-11cc745dc65d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:08 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:08 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db9701c-3593-46b3-bdef-0e48a3a31b0b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:08 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d Jul 05 17:26:08 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:09 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6" returned: 0 in 1.329s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:09 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 is being set with open permissions: ugo+rw Jul 05 17:26:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:09 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 Jul 05 17:26:09 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:09 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d" returned: 0 in 1.331s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:09 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 Jul 05 17:26:09 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:10 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6" returned: 0 in 0.738s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.905s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3e880690-e1c9-462a-9515-35c4f645dfc1 tempest-SnapshotsActionsTest-1392168243 None] Create snapshot completed successfully Jul 05 17:26:10 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404" returned: 0 in 0.886s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:10 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404 Jul 05 17:26:10 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:11 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d.7087ea10-e085-405a-bba4-09d4d32c2404" returned: 0 in 0.694s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-7087ea10-e085-405a-bba4-09d4d32c2404" released by "_delete_snapshot" :: held 3.991s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-a30e775d-40e8-40d1-a10b-11cc745dc65d" released by "delete_snapshot" :: held 4.021s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-d6ae6366-bedc-4a4e-afbc-8fd521146155" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-d6ae6366-bedc-4a4e-afbc-8fd521146155" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-8815bbe7-dfe7-4848-850e-0eae253833d8" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-8815bbe7-dfe7-4848-850e-0eae253833d8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Deleting offline snapshot 8815bbe7-dfe7-4848-850e-0eae253833d8 of volume d6ae6366-bedc-4a4e-afbc-8fd521146155 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] snapshot_file for this snap is: volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-3bae37ab-b66a-4866-be5f-9f2334b5b7a6-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328afa8-e4fc-4a33-b0e1-68a33657440f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-3bae37ab-b66a-4866-be5f-9f2334b5b7a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-quobyte-3bae37ab-b66a-4866-be5f-9f2334b5b7a6" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-3bae37ab-b66a-4866-be5f-9f2334b5b7a6" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Deleting offline snapshot 3bae37ab-b66a-4866-be5f-9f2334b5b7a6 of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] snapshot_file for this snap is: volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:26:11 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 Jul 05 17:26:11 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3703ec7-a748-41e8-aaa5-077b90999929]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:11 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 Jul 05 17:26:11 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:12 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8" returned: 0 in 0.975s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6ae6366-bedc-4a4e-afbc-8fd521146155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b9627b-3d60-4faa-9604-7c1070a47894]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:12 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6" returned: 0 in 1.005s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:12 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 Jul 05 17:26:12 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[37531e1a-9b57-41b0-b5bb-4cf03a0c5286]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:12 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:26:12 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Flow 'volume_create_manager' (5b9d59bf-674a-4399-94ef-70352e9ac91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929830f0-11ba-4744-9236-a3b6bef7280a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929830f0-11ba-4744-9236-a3b6bef7280a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1828509759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ec5888-792d-4b15-9a20-be7bf280a6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34995594e2a48eb912a0b36b0988862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:13Z,use_quota=True,user_id='b1bfd72a1ff14564a1c1160962f57dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b7b50a-59a7-46cf-b32e-6e16d1944c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b7b50a-59a7-46cf-b32e-6e16d1944c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318e730c-01b8-49d9-bf20-5b26cc7cc1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318e730c-01b8-49d9-bf20-5b26cc7cc1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ec5888-792d-4b15-9a20-be7bf280a6a0', 'volume_name': 'volume-10ec5888-792d-4b15-9a20-be7bf280a6a0', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256ee55b-026d-4428-aa2d-0232d19c5db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256ee55b-026d-4428-aa2d-0232d19c5db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbbb12a-33e4-467b-a33a-534d73de799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:13 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Volume 10ec5888-792d-4b15-9a20-be7bf280a6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ec5888-792d-4b15-9a20-be7bf280a6a0', 'volume_size': 1} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1828509759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ec5888-792d-4b15-9a20-be7bf280a6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34995594e2a48eb912a0b36b0988862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:13Z,use_quota=True,user_id='b1bfd72a1ff14564a1c1160962f57dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Creating volume 10ec5888-792d-4b15-9a20-be7bf280a6a0 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:26:13 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:13 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 1073741824 Jul 05 17:26:13 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:13 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155" returned: 0 in 1.323s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:13 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 Jul 05 17:26:13 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:14 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 1.377s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:14 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 Jul 05 17:26:14 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:14 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8" returned: 0 in 0.966s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:14 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8 Jul 05 17:26:14 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:14 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 1073741824" returned: 0 in 1.170s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:15 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 Jul 05 17:26:15 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:15 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6" returned: 0 in 0.923s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:15 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6 Jul 05 17:26:15 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:15 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155.8815bbe7-dfe7-4848-850e-0eae253833d8" returned: 0 in 0.858s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-8815bbe7-dfe7-4848-850e-0eae253833d8" released by "_delete_snapshot" :: held 4.291s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-d6ae6366-bedc-4a4e-afbc-8fd521146155" released by "delete_snapshot" :: held 4.328s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:15 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0" returned: 0 in 0.856s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbbb12a-33e4-467b-a33a-534d73de799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ec5888-792d-4b15-9a20-be7bf280a6a0', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a009f37-200a-4478-afc9-187eca0bd556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:15 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Volume volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 (10ec5888-792d-4b15-9a20-be7bf280a6a0): created successfully Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a009f37-200a-4478-afc9-187eca0bd556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Flow 'volume_create_manager' (5b9d59bf-674a-4399-94ef-70352e9ac91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:15 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.3bae37ab-b66a-4866-be5f-9f2334b5b7a6" returned: 0 in 0.841s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:15 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c86a33eb-e597-4d20-a425-a881f7b889b7 tempest-AttachVolumeNegativeTest-1919246832 None] Created volume successfully. Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-3bae37ab-b66a-4866-be5f-9f2334b5b7a6" released by "_delete_snapshot" :: held 4.284s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:15 devstack cinder-volume[86459]: WARNING cinder.quota [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-969198789 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-969198789, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:26:15 devstack cinder-volume[86459]: WARNING cinder.quota [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-969198789 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-969198789, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:26:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" released by "delete_snapshot" :: held 4.335s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:16 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Created reservations ['0cb1ab3e-a592-4b78-92f3-759c366881e2', 'b0247bc9-3255-4a21-a9f8-1bfe00895df0', 'f6e9f0e4-04be-4028-a4e2-a4906bfa907a', 'c6fc5c47-64c8-40e6-93da-f491c40a3660'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:16 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Created reservations ['526576d7-29fa-40ab-9b77-c5ed27564277', '88b3f61e-6051-4cb4-84fe-e2370ac58f49', '43633695-8c8e-4362-b8cd-b1eb6ea98ad8', 'b1f9b19c-fdf5-4ba4-b29b-fd38b5912feb'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Delete snapshot completed successfully. Jul 05 17:26:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7cf5ef2e-b4b4-4de3-b970-d12718af4cac tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-3bae37ab-b66a-4866-be5f-9f2334b5b7a6-delete_snapshot" released by "delete_snapshot" :: held 4.605s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:16 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] Created reservations ['672693aa-0662-4db7-812b-71908ef4285a', '8cdc325d-06eb-4541-b7f2-b6d530fb8634', '007325d6-89ce-4fb6-9db8-421ec55e6e65', '0843b818-bf5e-431d-aa33-6dc6c3f8d26e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0d04e9be-89e5-4e2a-87e2-ac5bf3af6a1e tempest-GroupSnapshotsTest-244745086 None] group_snapshot c4cc892b-1fad-4531-9662-9300d5ef299d: deleted successfully Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Creating offline snapshot bb82493a-826b-49ef-8454-184283bb1682 of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a781d9-0ef2-46a5-b3a8-dac40882bb3c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:17 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:26:17 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-a30e775d-40e8-40d1-a10b-11cc745dc65d" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-a30e775d-40e8-40d1-a10b-11cc745dc65d" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196d459-3f1f-4089-b75e-c7afffa36092]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:17 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d Jul 05 17:26:17 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:18 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.794s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:18 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 1G Jul 05 17:26:18 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:18 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d" returned: 0 in 0.808s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:18 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d Jul 05 17:26:18 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:18 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 1G" returned: 0 in 0.885s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:19 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 Jul 05 17:26:19 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:19 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a30e775d-40e8-40d1-a10b-11cc745dc65d" returned: 0 in 0.678s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-a30e775d-40e8-40d1-a10b-11cc745dc65d" released by "delete_volume" :: held 1.554s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-d6ae6366-bedc-4a4e-afbc-8fd521146155" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-d6ae6366-bedc-4a4e-afbc-8fd521146155" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d864667-1193-46be-bbe5-0b6b20a954e3]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:19 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 Jul 05 17:26:19 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:19 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682" returned: 0 in 0.762s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:19 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 is being set with open permissions: ugo+rw Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:19 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 Jul 05 17:26:19 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-051b771a-e674-4c53-91ea-d5a26fe7f5c2 req-9372b0a9-5398-433b-9fd8-a4acec01387d tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:20 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155" returned: 0 in 0.856s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:20 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155 Jul 05 17:26:20 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:20 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682" returned: 0 in 0.707s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.250s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-051b771a-e674-4c53-91ea-d5a26fe7f5c2 req-9372b0a9-5398-433b-9fd8-a4acec01387d tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.500s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba6b29b-ae6a-48c8-afc1-da67f49e193e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-051b771a-e674-4c53-91ea-d5a26fe7f5c2 req-9372b0a9-5398-433b-9fd8-a4acec01387d tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ae2ae00c-3b20-438a-810c-1dc634acea63 tempest-SnapshotsActionsTest-1392168243 None] Create snapshot completed successfully Jul 05 17:26:20 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 Jul 05 17:26:20 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:20 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d6ae6366-bedc-4a4e-afbc-8fd521146155" returned: 0 in 0.691s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-d6ae6366-bedc-4a4e-afbc-8fd521146155" released by "delete_volume" :: held 1.626s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Created reservations ['4c9efb7b-a18c-4883-a7ec-f897e8e7f425'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:20 devstack cinder-volume[86459]: WARNING cinder.quota [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-969198789 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-969198789, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:26:20 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Created reservations ['c4d15931-0570-4225-b6ae-191feb131ed7', 'c660d4f0-ec7e-4579-943e-4a64665a69ae', '64fbec5e-633d-4b04-937f-78874c432182', '164eae87-52cb-44a4-8fa3-bb5e92f912c1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Created reservations ['c8447a11-9667-42ae-9654-78fcf46dbb43', '145c276f-dc71-44c5-a613-73120c384088', '2b6e48b0-cf43-46ae-8147-0cc333a755a1', '05ddb8e7-7bd5-46c9-9473-837f689e2990'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:21 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:21 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:21 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-051b771a-e674-4c53-91ea-d5a26fe7f5c2 req-9372b0a9-5398-433b-9fd8-a4acec01387d tempest-AttachVolumeNegativeTest-1919246832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0" returned: 0 in 0.803s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-051b771a-e674-4c53-91ea-d5a26fe7f5c2 req-9372b0a9-5398-433b-9fd8-a4acec01387d tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.824s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-051b771a-e674-4c53-91ea-d5a26fe7f5c2 req-9372b0a9-5398-433b-9fd8-a4acec01387d tempest-AttachVolumeNegativeTest-1919246832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-10ec5888-792d-4b15-9a20-be7bf280a6a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35455056-6b6b-44ff-8b06-79a063e7a016', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:26:21 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-051b771a-e674-4c53-91ea-d5a26fe7f5c2 req-9372b0a9-5398-433b-9fd8-a4acec01387d tempest-AttachVolumeNegativeTest-1919246832 None] attachment_update completed successfully. Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-bb82493a-826b-49ef-8454-184283bb1682-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:21 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-104145ad-dd63-436d-9839-1d86863027d8 tempest-GroupSnapshotsTest-244745086 None] Group tempest-GroupSnapshotsTest-Group-236347383: creating Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-bb82493a-826b-49ef-8454-184283bb1682-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Acquiring lock "cinder-quobyte-bb82493a-826b-49ef-8454-184283bb1682" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-bb82493a-826b-49ef-8454-184283bb1682" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Deleting offline snapshot bb82493a-826b-49ef-8454-184283bb1682 of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:26:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] snapshot_file for this snap is: volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:26:21 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-104145ad-dd63-436d-9839-1d86863027d8 tempest-GroupSnapshotsTest-244745086 None] Group tempest-GroupSnapshotsTest-Group-236347383: created successfully Jul 05 17:26:22 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc2318b-4990-4dbd-a0ad-8c11f18734df]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:22 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-104145ad-dd63-436d-9839-1d86863027d8 tempest-GroupSnapshotsTest-244745086 None] Create group completed successfully. Jul 05 17:26:22 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.983s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:22 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:22 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-76bc0836-2590-4210-9b3e-2077fce31a0d tempest-GroupSnapshotsTest-244745086 None] Delete group completed successfully. Jul 05 17:26:22 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 Jul 05 17:26:22 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:22 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682" returned: 0 in 0.797s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:22 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e10928-2e69-4d03-81c5-1d3ea82fb0fc]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:22 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:26:22 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Flow 'volume_create_manager' (456bc7ae-ec54-4a72-95f8-95ebf7b1c7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4e3287-65c0-4eb5-9099-57a98b0f1561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4e3287-65c0-4eb5-9099-57a98b0f1561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-212768567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf1e010f-53fc-467d-bc13-73ba38e2aba0,host='devstack@QuobyteHD#QuobyteHD',id=8a0f805d-c5a8-46e1-8008-03a1cbefbc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1759f0ad48944d6083badc42c90de7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:23Z,use_quota=True,user_id='cf9cfb47d5794f589ad31100f9dbb3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(500639ee-4fdc-47d3-83c7-26cfdda8d4c5),volume_type_id=500639ee-4fdc-47d3-83c7-26cfdda8d4c5)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba30dd4-5e15-4003-9299-06f14c4382d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba30dd4-5e15-4003-9299-06f14c4382d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569f37e1-c6b4-4b12-ac6f-10673fdf409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569f37e1-c6b4-4b12-ac6f-10673fdf409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0f805d-c5a8-46e1-8008-03a1cbefbc76', 'volume_name': 'volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbeb691-9e5a-4d67-a3bb-5494d5c0c850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbeb691-9e5a-4d67-a3bb-5494d5c0c850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b47c4b5-d6f4-4ba2-a277-be9e90765ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:23 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Volume 8a0f805d-c5a8-46e1-8008-03a1cbefbc76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76', 'volume_size': 1} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cf1e010f-53fc-467d-bc13-73ba38e2aba0,created_at=2026-07-05T15:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-212768567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf1e010f-53fc-467d-bc13-73ba38e2aba0,host='devstack@QuobyteHD#QuobyteHD',id=8a0f805d-c5a8-46e1-8008-03a1cbefbc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1759f0ad48944d6083badc42c90de7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:23Z,use_quota=True,user_id='cf9cfb47d5794f589ad31100f9dbb3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(500639ee-4fdc-47d3-83c7-26cfdda8d4c5),volume_type_id=500639ee-4fdc-47d3-83c7-26cfdda8d4c5)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Creating volume 8a0f805d-c5a8-46e1-8008-03a1cbefbc76 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:26:23 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:23 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 1073741824 Jul 05 17:26:23 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:23 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.893s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:23 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 Jul 05 17:26:23 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:24 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 1073741824" returned: 0 in 0.932s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:24 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 Jul 05 17:26:24 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:24 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682" returned: 0 in 0.872s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:24 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682 Jul 05 17:26:24 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:25 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" returned: 0 in 0.747s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b47c4b5-d6f4-4ba2-a277-be9e90765ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604501dd-3775-4163-bf11-aaa365dcaa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:25 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Volume volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 (8a0f805d-c5a8-46e1-8008-03a1cbefbc76): created successfully Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604501dd-3775-4163-bf11-aaa365dcaa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Flow 'volume_create_manager' (456bc7ae-ec54-4a72-95f8-95ebf7b1c7f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b9458d7d-2db8-4551-adb8-fcd32a423388 tempest-GroupSnapshotsTest-244745086 None] Created volume successfully. Jul 05 17:26:25 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.bb82493a-826b-49ef-8454-184283bb1682" returned: 0 in 0.782s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-bb82493a-826b-49ef-8454-184283bb1682" released by "_delete_snapshot" :: held 3.479s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" released by "delete_snapshot" :: held 3.526s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Created reservations ['bcb5c77d-64c1-418e-907b-b281d7c93a9b', 'a508f0ce-1c22-41eb-81da-5d8c6bad1f5a', 'e7075541-55e4-42aa-9a7c-5010ca87ecf7', 'a9a2a983-6086-439f-9a69-eeb8de3c205c'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Delete snapshot completed successfully. Jul 05 17:26:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a05ccc1-6d81-43d7-b1d7-9426603d4179 tempest-SnapshotsActionsTest-1372504404 None] Lock "cinder-bb82493a-826b-49ef-8454-184283bb1682-delete_snapshot" released by "delete_snapshot" :: held 3.692s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:26 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] GroupSnapshot bf7909fe-63c0-4faf-8d61-28e5fcf38e52: creating. Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Group snapshot bf7909fe-63c0-4faf-8d61-28e5fcf38e52: creating. {{(pid=86459) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Creating offline snapshot b86447c6-897b-4fc5-8083-26925e5fd677 of volume 8a0f805d-c5a8-46e1-8008-03a1cbefbc76 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc421d51-83a7-4619-bfd7-2e826436f1db]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:26 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 Jul 05 17:26:26 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "cinder-f7412510-d7c5-4265-b0fe-0e31c7d94364-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-f7412510-d7c5-4265-b0fe-0e31c7d94364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "cinder-quobyte-f7412510-d7c5-4265-b0fe-0e31c7d94364" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-quobyte-f7412510-d7c5-4265-b0fe-0e31c7d94364" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Deleting offline snapshot f7412510-d7c5-4265-b0fe-0e31c7d94364 of volume 7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] snapshot_file for this snap is: volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[572a4b79-eb16-44c8-80ca-e8c955d673ec]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:26 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:26:26 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:27 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" returned: 0 in 0.930s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:27 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 1G Jul 05 17:26:27 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:27 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.907s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7909e75c-b133-4b0a-abcb-4669dfee3778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac887c5-6b8c-4558-bd5e-129b17e0729d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:27 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 Jul 05 17:26:27 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-bee769ec-e97b-4483-90db-e15cff2d6451 req-3468f69a-d35f-44ec-ad6b-157dcdd1ecd1 tempest-AttachVolumeNegativeTest-1919246832 None] Terminate volume connection completed successfully. Jul 05 17:26:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-bee769ec-e97b-4483-90db-e15cff2d6451 req-3468f69a-d35f-44ec-ad6b-157dcdd1ecd1 tempest-AttachVolumeNegativeTest-1919246832 None] Deleting attachment 35455056-6b6b-44ff-8b06-79a063e7a016. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:26:28 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 1G" returned: 0 in 1.067s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:28 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 Jul 05 17:26:28 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Acquiring lock "cinder-40b98d17-84e7-4f40-906e-3e02b6ae28d8-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Lock "cinder-40b98d17-84e7-4f40-906e-3e02b6ae28d8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Acquiring lock "cinder-quobyte-40b98d17-84e7-4f40-906e-3e02b6ae28d8" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Lock "cinder-quobyte-40b98d17-84e7-4f40-906e-3e02b6ae28d8" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d4d17-fa8c-4420-96e3-591c6fa95939]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:28 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778" returned: 0 in 0.959s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:28 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 Jul 05 17:26:28 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:28 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:26:28 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:28 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677" returned: 0 in 0.775s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:28 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:26:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:29 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 Jul 05 17:26:29 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:29 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8" returned: 0 in 0.836s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:29 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8 Jul 05 17:26:29 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:29 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.780s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:29 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364 Jul 05 17:26:29 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:29 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677" returned: 0 in 0.726s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:29 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.info Jul 05 17:26:29 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:30 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-40b98d17-84e7-4f40-906e-3e02b6ae28d8" returned: 0 in 0.751s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Lock "cinder-quobyte-40b98d17-84e7-4f40-906e-3e02b6ae28d8" released by "delete_volume" :: held 1.640s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=145,cinder:UPDATE=140,cinder:DELETE=8,cinder:INSERT=36 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=144,cinder:SELECT=135,cinder:INSERT=34,cinder:DELETE=7 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:26:30 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778.f7412510-d7c5-4265-b0fe-0e31c7d94364" returned: 0 in 0.778s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Created reservations ['a7b99642-a192-4b0a-8fae-146caa9b901a', '779e6540-6684-4e69-a4fd-e49a1b0dbb02', 'fdf3e30b-0aef-4d19-9f50-6bda3bbd5f00', 'd00dce84-f8cb-441d-bae4-ae327586a931'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-quobyte-f7412510-d7c5-4265-b0fe-0e31c7d94364" released by "_delete_snapshot" :: held 3.593s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" released by "delete_snapshot" :: held 3.623s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Created reservations ['78cb5a77-f795-4e36-916c-a3e9ab66bfd5', 'a6948b18-0d6d-40a4-8942-290f7971fd9e', '633364fb-45b9-4c07-9338-23b8732b06e3', '59e02947-a85e-4d71-8285-126ddd375c17'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:30 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:30 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:30 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Delete snapshot completed successfully. Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-84ab6744-78f9-4c83-a005-27bd4db09f94 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-f7412510-d7c5-4265-b0fe-0e31c7d94364-delete_snapshot" released by "delete_snapshot" :: held 3.850s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:30 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.info" returned: 0 in 0.851s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:30 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:30 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.info Jul 05 17:26:30 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "cinder-7909e75c-b133-4b0a-abcb-4669dfee3778-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-7909e75c-b133-4b0a-abcb-4669dfee3778-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6081a8-eaa7-4926-b2ed-443a5b4e6599]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:31 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.855s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Deleted volume successfully. Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8226fcef-b587-46c7-aa9a-d28f60604d3f tempest-VolumesNegativeTest-537915217 None] Lock "cinder-40b98d17-84e7-4f40-906e-3e02b6ae28d8-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:31 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 Jul 05 17:26:31 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:31 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.info" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.249s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c670f244-eae2-40de-9621-c92405f85e0d tempest-GroupSnapshotsTest-244745086 None] group_snapshot bf7909fe-63c0-4faf-8d61-28e5fcf38e52: created successfully Jul 05 17:26:32 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778" returned: 0 in 1.064s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:32 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778 Jul 05 17:26:32 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] group_snapshot bf7909fe-63c0-4faf-8d61-28e5fcf38e52: deleting Jul 05 17:26:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] group_snapshot bf7909fe-63c0-4faf-8d61-28e5fcf38e52: deleting {{(pid=86459) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 17:26:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-b86447c6-897b-4fc5-8083-26925e5fd677" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-b86447c6-897b-4fc5-8083-26925e5fd677" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Deleting offline snapshot b86447c6-897b-4fc5-8083-26925e5fd677 of volume 8a0f805d-c5a8-46e1-8008-03a1cbefbc76 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] snapshot_file for this snap is: volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebca2ee2-958d-4eec-af21-d69825c73dd7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:33 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7909e75c-b133-4b0a-abcb-4669dfee3778" returned: 0 in 0.930s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:33 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 Jul 05 17:26:33 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-quobyte-7909e75c-b133-4b0a-abcb-4669dfee3778" released by "delete_volume" :: held 2.084s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Created reservations ['ad459a08-7603-479b-9421-1fc7f573d9e9', '181303b8-0c0d-4309-a7e5-3fed347083ed', '7615ab72-73d4-4fde-b79b-848b10018329', '15c8cc51-ea25-4f5d-a695-69b6cfd37e43'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:33 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:33 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:34 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677" returned: 0 in 1.070s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1750ca7b-5e3a-4b87-a50f-6c95b6c3696d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Flow 'volume_create_manager' (17122536-58d5-4feb-8380-cd20ab88f854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2384c0-ad79-4604-a3bf-42a795821a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2384c0-ad79-4604-a3bf-42a795821a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2145791863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195f3e8f-b04b-4dd0-92c5-44072ac91de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f486d2ed537642918d8450faf7963cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:34Z,use_quota=True,user_id='537bb9e3a580477d8d03d98f753144ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287901a9-0953-4eae-9664-87aed61f97c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287901a9-0953-4eae-9664-87aed61f97c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73c1672-758d-4d71-b355-d5eb19c418d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73c1672-758d-4d71-b355-d5eb19c418d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '195f3e8f-b04b-4dd0-92c5-44072ac91de9', 'volume_name': 'volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e160a6a-e972-4d1e-a1a8-4e47ad3806dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e160a6a-e972-4d1e-a1a8-4e47ad3806dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0f30a5-5c05-467b-8517-62975008dc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Volume 195f3e8f-b04b-4dd0-92c5-44072ac91de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9', 'volume_size': 1} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2145791863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195f3e8f-b04b-4dd0-92c5-44072ac91de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f486d2ed537642918d8450faf7963cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:34Z,use_quota=True,user_id='537bb9e3a580477d8d03d98f753144ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Creating volume 195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:26:34 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:34 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 Jul 05 17:26:34 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:34 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.905s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Deleted volume successfully. Jul 05 17:26:34 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 1073741824 Jul 05 17:26:34 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b85c15c9-5354-4355-ae04-048e67107415 tempest-SnapshotsActionsTest-1392168243 None] Lock "cinder-7909e75c-b133-4b0a-abcb-4669dfee3778-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:35 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" returned: 0 in 0.928s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:35 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 Jul 05 17:26:35 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:35 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 1073741824" returned: 0 in 0.991s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:35 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 Jul 05 17:26:35 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:35 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677" returned: 0 in 0.845s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:35 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677 Jul 05 17:26:35 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:36 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0f30a5-5c05-467b-8517-62975008dc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d103cb1-9a68-47ec-9ab4-d459d0988239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:36 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Volume volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 (195f3e8f-b04b-4dd0-92c5-44072ac91de9): created successfully Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d103cb1-9a68-47ec-9ab4-d459d0988239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Flow 'volume_create_manager' (17122536-58d5-4feb-8380-cd20ab88f854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-524beecb-a63c-49f2-b1dc-7990edb22bf4 tempest-VolumesSnapshotListTestJSON-1664448703 None] Created volume successfully. Jul 05 17:26:36 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76.b86447c6-897b-4fc5-8083-26925e5fd677" returned: 0 in 0.763s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-b86447c6-897b-4fc5-8083-26925e5fd677" released by "_delete_snapshot" :: held 3.754s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" released by "delete_snapshot" :: held 3.788s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:36 devstack cinder-volume[86459]: WARNING cinder.quota [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-961101353 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-961101353, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:26:36 devstack cinder-volume[86459]: WARNING cinder.quota [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-961101353 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-961101353, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:26:36 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] Created reservations ['d6b12607-04dc-4bb5-9cbb-a600f508bb19', '9089986f-a95f-43ea-b334-256a70d6d29f', '831e6411-d40e-4905-923a-cc9008f76118', '4b6ac274-eeea-4b6c-a161-e582f68aed05'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5042821d-0388-4e10-9d5a-96fdf2c07012 tempest-GroupSnapshotsTest-244745086 None] group_snapshot bf7909fe-63c0-4faf-8d61-28e5fcf38e52: deleted successfully Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Creating offline snapshot ec8a93e4-f9a0-4a48-973b-3a17f11ed374 of volume 195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "cinder-quobyte-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d959d0-8ab9-4b02-94fc-dbfb26daaa2c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" acquired by "delete_volume" :: waited 0.055s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[74521e24-81c7-4614-8bc0-02cd2808754c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:37 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 Jul 05 17:26:37 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:37 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 Jul 05 17:26:37 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:38 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9" returned: 0 in 0.922s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:38 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 1G Jul 05 17:26:38 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:38 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" returned: 0 in 0.924s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:38 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76 Jul 05 17:26:38 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "cinder-10ec5888-792d-4b15-9a20-be7bf280a6a0-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-10ec5888-792d-4b15-9a20-be7bf280a6a0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "cinder-quobyte-10ec5888-792d-4b15-9a20-be7bf280a6a0" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-quobyte-10ec5888-792d-4b15-9a20-be7bf280a6a0" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cc3463-ee25-46f9-8219-a0f8d9f82cbf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:39 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 Jul 05 17:26:39 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:39 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" returned: 0 in 0.871s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Lock "cinder-quobyte-8a0f805d-c5a8-46e1-8008-03a1cbefbc76" released by "delete_volume" :: held 1.887s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Created reservations ['ec65db90-0800-477b-89d1-0aa1d89f7ee8'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:39 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 1G" returned: 0 in 1.096s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:39 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 Jul 05 17:26:39 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:39 devstack cinder-volume[86459]: WARNING cinder.quota [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-961101353 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-961101353, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Created reservations ['156adfca-9517-4f57-8241-ba24638ff3af', '939a71f4-27e3-49cc-8187-97fedc793d17', 'fc1fc688-5780-4d40-8d46-82e4ee025ceb', 'c2957d07-6b12-4ed9-a6d2-87baac9dc15c'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:39 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:39 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:40 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0" returned: 0 in 0.957s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:40 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0 Jul 05 17:26:40 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:40 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374" returned: 0 in 1.143s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:40 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 is being set with open permissions: ugo+rw Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:40 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 Jul 05 17:26:40 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:40 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.932s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Flow 'volume_create_manager' (bd74fff2-b185-4589-9f7c-4d7b840baae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2338a06-4290-4728-9174-520e208a372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-aac67485-fdb2-49a9-af38-30b8b83966f8 tempest-GroupSnapshotsTest-244745086 None] Delete group completed successfully. Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2338a06-4290-4728-9174-520e208a372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-80045694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6913bed4-a4c4-4b63-bf94-67acfb0a6907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6675eec9584f45afb6232522ca7f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:41Z,use_quota=True,user_id='bf2c511123b84e45b19c907b864e873d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d7e257-0e9a-4163-9226-c4a2c44f73bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d7e257-0e9a-4163-9226-c4a2c44f73bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02704673-b69b-4295-8f4f-70fb8415d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02704673-b69b-4295-8f4f-70fb8415d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6913bed4-a4c4-4b63-bf94-67acfb0a6907', 'volume_name': 'volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8d45ae-9909-4a8e-8cf3-e899f55b8222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8d45ae-9909-4a8e-8cf3-e899f55b8222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f46c6a1-407b-41a2-9e8b-645a168052a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Volume 6913bed4-a4c4-4b63-bf94-67acfb0a6907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907', 'volume_size': 1} Jul 05 17:26:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:41 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-10ec5888-792d-4b15-9a20-be7bf280a6a0" returned: 0 in 0.985s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-quobyte-10ec5888-792d-4b15-9a20-be7bf280a6a0" released by "delete_volume" :: held 1.991s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Created reservations ['eaa2fe95-b868-4e05-8de0-84f916135371', '81918464-05d1-4b27-a57d-dfd01e127fdc', '2c24d314-16b0-446c-a36f-faf372b5c49c', '5a5d5876-dfbf-4cc3-9358-82874b07587b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:41 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:41 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:41 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374" returned: 0 in 0.759s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:41 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.info Jul 05 17:26:41 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "cinder-2f0f3780-a6e7-42f7-b220-e6193c5390d5-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-2f0f3780-a6e7-42f7-b220-e6193c5390d5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "cinder-quobyte-2f0f3780-a6e7-42f7-b220-e6193c5390d5" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-quobyte-2f0f3780-a6e7-42f7-b220-e6193c5390d5" acquired by "delete_volume" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d31c86-3ebf-4650-ad35-c15ef2c7a01e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:42 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 Jul 05 17:26:42 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:42 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.008s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:42 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Deleted volume successfully. Jul 05 17:26:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3e687bd7-75cb-4a48-b922-458781657507 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-10ec5888-792d-4b15-9a20-be7bf280a6a0-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:42 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.info" returned: 0 in 1.004s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:42 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.info is being set with open permissions: ugo+rw Jul 05 17:26:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:42 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.info Jul 05 17:26:42 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:43 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5" returned: 0 in 1.161s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:43 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5 Jul 05 17:26:43 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:43 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.info" returned: 0 in 0.774s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.882s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.461s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-80045694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6913bed4-a4c4-4b63-bf94-67acfb0a6907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6675eec9584f45afb6232522ca7f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:41Z,use_quota=True,user_id='bf2c511123b84e45b19c907b864e873d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Creating volume 6913bed4-a4c4-4b63-bf94-67acfb0a6907 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:26:43 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:26:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:43 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 1073741824 Jul 05 17:26:43 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:43 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-43d1a994-832b-4372-b991-cd5822defbfe tempest-VolumesSnapshotListTestJSON-1664448703 None] Create snapshot completed successfully Jul 05 17:26:44 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2f0f3780-a6e7-42f7-b220-e6193c5390d5" returned: 0 in 0.931s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-quobyte-2f0f3780-a6e7-42f7-b220-e6193c5390d5" released by "delete_volume" :: held 2.169s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Created reservations ['1de74162-42f1-42fa-9def-bfb2f8986ca0', '71d3e65e-4257-47b8-ac76-8db8758a10bf', 'f64dbaaf-87a0-48ba-b0f8-594106f822af', '94fc7e1f-efef-4a56-b40b-6178c2b564da'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:44 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:44 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:44 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 1073741824" returned: 0 in 0.996s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:44 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 Jul 05 17:26:44 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:44 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.692s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:44 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Deleted volume successfully. Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d86ee6fd-5e86-4afa-ba8a-bd8266092c4f tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-2f0f3780-a6e7-42f7-b220-e6193c5390d5-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:45 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907" returned: 0 in 0.734s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.999s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Creating offline snapshot 2c3286b9-0341-45b1-a9d2-e6614f0b737b of volume 195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f46c6a1-407b-41a2-9e8b-645a168052a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bbf328-f787-4082-9525-3f45a004823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c10200a-c48b-483e-a60d-b69504fde336]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:45 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Volume volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 (6913bed4-a4c4-4b63-bf94-67acfb0a6907): created successfully Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bbf328-f787-4082-9525-3f45a004823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Flow 'volume_create_manager' (bd74fff2-b185-4589-9f7c-4d7b840baae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "cinder-f9bf26a9-8f69-4f90-b65e-edc126629074-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:45 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3bae5fd6-8aaa-4ba1-bd90-419e355881ae tempest-VolumesServicesTestJSON-980373773 None] Created volume successfully. Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-f9bf26a9-8f69-4f90-b65e-edc126629074-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "cinder-quobyte-f9bf26a9-8f69-4f90-b65e-edc126629074" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-quobyte-f9bf26a9-8f69-4f90-b65e-edc126629074" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f9df45-8cea-40a8-af25-aed1003d9a8c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:45 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 Jul 05 17:26:45 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:45 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 Jul 05 17:26:45 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:46 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374" returned: 0 in 0.901s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:46 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b 1G Jul 05 17:26:46 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:46 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074" returned: 0 in 0.874s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Acquiring lock "cinder-6913bed4-a4c4-4b63-bf94-67acfb0a6907-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:46 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074 Jul 05 17:26:46 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Lock "cinder-6913bed4-a4c4-4b63-bf94-67acfb0a6907-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Acquiring lock "cinder-quobyte-6913bed4-a4c4-4b63-bf94-67acfb0a6907" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Lock "cinder-quobyte-6913bed4-a4c4-4b63-bf94-67acfb0a6907" acquired by "delete_volume" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ccaacd-20d2-451b-98a6-fbd272bf949b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fc28d626-c99a-46af-a85d-c45b14494f2b tempest-GroupSnapshotsV319Test-462020523 None] Group tempest-GroupSnapshotsV319Test-Group-1805104295: creating Jul 05 17:26:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fc28d626-c99a-46af-a85d-c45b14494f2b tempest-GroupSnapshotsV319Test-462020523 None] Group tempest-GroupSnapshotsV319Test-Group-1805104295: created successfully Jul 05 17:26:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fc28d626-c99a-46af-a85d-c45b14494f2b tempest-GroupSnapshotsV319Test-462020523 None] Create group completed successfully. Jul 05 17:26:46 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 Jul 05 17:26:46 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:47 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b 1G" returned: 0 in 0.943s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:47 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9bf26a9-8f69-4f90-b65e-edc126629074" returned: 0 in 0.817s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:47 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b Jul 05 17:26:47 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-quobyte-f9bf26a9-8f69-4f90-b65e-edc126629074" released by "delete_volume" :: held 1.742s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Created reservations ['31928693-bb94-4412-9f28-feac2872505e', '9ebe367e-b8b5-407b-9fb2-8ad3ef8ec725', '188d7f8b-6b93-41c4-8754-510d65cf3dc9', 'ace9d375-6012-4c17-a257-f2c632cf7cd8'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:47 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:47 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:47 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907" returned: 0 in 0.882s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:47 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907 Jul 05 17:26:47 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:48 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b" returned: 0 in 0.856s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:48 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b is being set with open permissions: ugo+rw Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:48 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b Jul 05 17:26:48 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:48 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.871s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Deleted volume successfully. Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a51448c7-fab9-447e-a41a-553bbe573407 tempest-AttachVolumeNegativeTest-1919246832 None] Lock "cinder-f9bf26a9-8f69-4f90-b65e-edc126629074-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:48 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6913bed4-a4c4-4b63-bf94-67acfb0a6907" returned: 0 in 0.823s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Lock "cinder-quobyte-6913bed4-a4c4-4b63-bf94-67acfb0a6907" released by "delete_volume" :: held 1.774s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Created reservations ['cf01bc6d-8ba1-48fb-9937-5b25ea3a0dd0', '4818e0e3-054d-4d9d-92ce-049a852d84cb', 'd76191e9-1442-4f1b-9ecf-4be03902ca07', 'e8f07a6d-d7ab-4347-84eb-9f377acaf435'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:48 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:48 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Flow 'volume_create_manager' (5f2a782a-ab95-4a86-ad91-70c6a3e44724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d3ab8b-1320-4602-8ee7-54f13b71f35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d3ab8b-1320-4602-8ee7-54f13b71f35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1284424519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e18ca798-9123-4445-9e80-b4960ff727d8,host='devstack@QuobyteHD#QuobyteHD',id=1c404abe-7ebd-48fd-840f-a86af0ce6465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af3cc1ba1d4013a978a9bee5550913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:49Z,use_quota=True,user_id='d32cf2e1f6f64f00a0a6fb874e2c65cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c45917-1203-4815-b3fe-da10ae9acce8),volume_type_id=90c45917-1203-4815-b3fe-da10ae9acce8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3733c2e1-9d8f-4e25-9c9f-f6568db8997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3733c2e1-9d8f-4e25-9c9f-f6568db8997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17200f8-0bef-4af6-9a7c-a3f24c4f2d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17200f8-0bef-4af6-9a7c-a3f24c4f2d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c404abe-7ebd-48fd-840f-a86af0ce6465', 'volume_name': 'volume-1c404abe-7ebd-48fd-840f-a86af0ce6465', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de7f772-b59b-4204-998f-2e4f1249ab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de7f772-b59b-4204-998f-2e4f1249ab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bc049a-04d5-4286-83bc-d56e16838ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:48 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Volume 1c404abe-7ebd-48fd-840f-a86af0ce6465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c404abe-7ebd-48fd-840f-a86af0ce6465', 'volume_size': 1} Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:48 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b" returned: 0 in 0.972s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.800s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.254s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e18ca798-9123-4445-9e80-b4960ff727d8,created_at=2026-07-05T15:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1284424519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e18ca798-9123-4445-9e80-b4960ff727d8,host='devstack@QuobyteHD#QuobyteHD',id=1c404abe-7ebd-48fd-840f-a86af0ce6465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af3cc1ba1d4013a978a9bee5550913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:49Z,use_quota=True,user_id='d32cf2e1f6f64f00a0a6fb874e2c65cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c45917-1203-4815-b3fe-da10ae9acce8),volume_type_id=90c45917-1203-4815-b3fe-da10ae9acce8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Creating volume 1c404abe-7ebd-48fd-840f-a86af0ce6465 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:26:49 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:49 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 1073741824 Jul 05 17:26:49 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-22049958-c399-4edb-bead-e8774cc1ede1 tempest-VolumesSnapshotListTestJSON-1664448703 None] Create snapshot completed successfully Jul 05 17:26:49 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.886s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Deleted volume successfully. Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-83c421dc-2e83-4e93-b49c-85346b4602f4 tempest-VolumesServicesTestJSON-980373773 None] Lock "cinder-6913bed4-a4c4-4b63-bf94-67acfb0a6907-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:50 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 1073741824" returned: 0 in 1.182s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:50 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 Jul 05 17:26:50 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:50 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:26:50 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:51 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465" returned: 0 in 0.777s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.229s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bc049a-04d5-4286-83bc-d56e16838ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c404abe-7ebd-48fd-840f-a86af0ce6465', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecbd6f3-b497-44ef-b77c-e0d5a6edb1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Creating offline snapshot c53ef1e2-47c5-4cd5-9b13-7ef044af8142 of volume 195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:26:51 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Volume volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 (1c404abe-7ebd-48fd-840f-a86af0ce6465): created successfully Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecbd6f3-b497-44ef-b77c-e0d5a6edb1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Flow 'volume_create_manager' (5f2a782a-ab95-4a86-ad91-70c6a3e44724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8daf1e1-63a5-4a85-990f-f39a76046fd8]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f2e9ea68-ee12-44cf-8b0a-49888fad2908 tempest-GroupSnapshotsV319Test-462020523 None] Created volume successfully. Jul 05 17:26:51 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b Jul 05 17:26:51 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:51 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.928s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:26:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:26:52 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b" returned: 0 in 0.974s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:52 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 1G Jul 05 17:26:52 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:52 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] GroupSnapshot 79cc986e-a343-4dc3-9d58-8e21a12bdf26: creating. Jul 05 17:26:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Group snapshot 79cc986e-a343-4dc3-9d58-8e21a12bdf26: creating. {{(pid=86459) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 17:26:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:53 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 1G" returned: 0 in 1.232s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:53 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 Jul 05 17:26:53 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:54 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:54 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 is being set with open permissions: ugo+rw Jul 05 17:26:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:54 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 Jul 05 17:26:54 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:54 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142" returned: 0 in 0.674s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.845s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.899s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Creating offline snapshot 99a3e249-418b-4af1-853f-baf26058e835 of volume 1c404abe-7ebd-48fd-840f-a86af0ce6465 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:26:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6714c12d-c048-4ea3-83ef-399c25efb3b2 tempest-VolumesSnapshotListTestJSON-1664448703 None] Create snapshot completed successfully Jul 05 17:26:54 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d92ca1-5b7c-45b4-b3fd-ca9cdd0d094a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:55 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 Jul 05 17:26:55 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:55 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465" returned: 0 in 0.920s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:55 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 1G Jul 05 17:26:55 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-c53ef1e2-47c5-4cd5-9b13-7ef044af8142-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-c53ef1e2-47c5-4cd5-9b13-7ef044af8142-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-quobyte-c53ef1e2-47c5-4cd5-9b13-7ef044af8142" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-c53ef1e2-47c5-4cd5-9b13-7ef044af8142" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Deleting offline snapshot c53ef1e2-47c5-4cd5-9b13-7ef044af8142 of volume 195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] snapshot_file for this snap is: volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1356483-9353-4c79-adbe-ef065a4b0512]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:56 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 Jul 05 17:26:56 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Flow 'volume_create_manager' (be8f58d3-cd26-425f-89b7-8ef81acffa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ca55cf-2895-4cdf-830c-00fd9b564e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ca55cf-2895-4cdf-830c-00fd9b564e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-808628432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f44c83e-3806-41e0-8f36-60d9d77bd6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79dbb8f46c5479694b388ee0d5c0903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:57Z,use_quota=True,user_id='0ababdc80f3d4b28a47dced9256d2fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c9b35d9-0b4b-4709-80d3-6e236740c1eb),volume_type_id=9c9b35d9-0b4b-4709-80d3-6e236740c1eb)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71d5c56-73af-4dd0-8346-f588e66850f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71d5c56-73af-4dd0-8346-f588e66850f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417e01a8-ccf6-42a1-b0ab-2fdd11179870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417e01a8-ccf6-42a1-b0ab-2fdd11179870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f44c83e-3806-41e0-8f36-60d9d77bd6b4', 'volume_name': 'volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e061a758-40ba-4fdf-bb1b-d927fbe89d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e061a758-40ba-4fdf-bb1b-d927fbe89d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb25627-53c5-4fc1-a2fd-dcb3c7f385ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:56 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Volume 1f44c83e-3806-41e0-8f36-60d9d77bd6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4', 'volume_size': 1} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:56 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 1G" returned: 0 in 1.000s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:56 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 Jul 05 17:26:56 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:57 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Flow 'volume_create_manager' (2fe992d4-325e-456c-994b-0a8d5671b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d529357c-3f97-4b21-992a-3442098d2c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142" returned: 0 in 0.992s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d529357c-3f97-4b21-992a-3442098d2c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1645825534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ceb08e-9673-4d7a-91be-dc09023eb74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82eadb649fe1484799aee4b07c6c6d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:57Z,use_quota=True,user_id='07700a5e5f0c44caa3231ad8090a3a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600b993a-8a48-4f66-b2d1-806339211ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600b993a-8a48-4f66-b2d1-806339211ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8db0b6e-fa57-4b8e-a4f5-064a061f31b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8db0b6e-fa57-4b8e-a4f5-064a061f31b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ceb08e-9673-4d7a-91be-dc09023eb74b', 'volume_name': 'volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd7b75e-4b7a-43b2-bf70-fe4f4c1278db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd7b75e-4b7a-43b2-bf70-fe4f4c1278db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df63f89-99ac-4ecf-9498-4fdc1fe5735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:26:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Volume e7ceb08e-9673-4d7a-91be-dc09023eb74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b', 'volume_size': 1} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c322a43e-6b6c-46d6-978e-cfd34bfb0bbc]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:57 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b Jul 05 17:26:57 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:57 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835" returned: 0 in 0.775s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:57 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:57 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 Jul 05 17:26:57 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:57 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b" returned: 0 in 0.798s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:26:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:58 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 Jul 05 17:26:58 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:58 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835" returned: 0 in 0.638s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:58 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.info Jul 05 17:26:58 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:58 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142" returned: 0 in 0.830s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:58 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142 Jul 05 17:26:58 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:58 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.info" returned: 0 in 0.659s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:58 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 17:26:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:59 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.info Jul 05 17:26:59 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:59 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.c53ef1e2-47c5-4cd5-9b13-7ef044af8142" returned: 0 in 0.692s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-c53ef1e2-47c5-4cd5-9b13-7ef044af8142" released by "_delete_snapshot" :: held 3.475s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" released by "delete_snapshot" :: held 3.506s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Created reservations ['4b0cde9f-1e96-4fb1-b49f-bf63319845ec', '9eeb4624-e83c-496d-a2d4-ad254309bb45', '7ba182d2-44d0-4bd0-adeb-e5783fc15680', 'c5495bb2-3b55-497b-8bdf-0899edac49a8'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:26:59 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Delete snapshot completed successfully. Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25be0839-7bf9-4127-8212-9e9e0a85a9fb tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-c53ef1e2-47c5-4cd5-9b13-7ef044af8142-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:26:59 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.info" returned: 0 in 0.711s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.802s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.993s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-808628432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f44c83e-3806-41e0-8f36-60d9d77bd6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79dbb8f46c5479694b388ee0d5c0903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:57Z,use_quota=True,user_id='0ababdc80f3d4b28a47dced9256d2fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c9b35d9-0b4b-4709-80d3-6e236740c1eb),volume_type_id=9c9b35d9-0b4b-4709-80d3-6e236740c1eb)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Creating volume 1f44c83e-3806-41e0-8f36-60d9d77bd6b4 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:26:59 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:26:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:26:59 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 1073741824 Jul 05 17:26:59 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:26:59 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5aa10b50-1f8e-4759-bd6c-f27e15a07aa1 tempest-GroupSnapshotsV319Test-462020523 None] group_snapshot 79cc986e-a343-4dc3-9d58-8e21a12bdf26: created successfully Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-2c3286b9-0341-45b1-a9d2-e6614f0b737b-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-2c3286b9-0341-45b1-a9d2-e6614f0b737b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-quobyte-2c3286b9-0341-45b1-a9d2-e6614f0b737b" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-2c3286b9-0341-45b1-a9d2-e6614f0b737b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Deleting offline snapshot 2c3286b9-0341-45b1-a9d2-e6614f0b737b of volume 195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] snapshot_file for this snap is: volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af6179b-b10a-4feb-a63e-3072784850e5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:00 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b Jul 05 17:27:00 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:00 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 1073741824" returned: 0 in 0.891s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:00 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 Jul 05 17:27:00 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] group_snapshot 79cc986e-a343-4dc3-9d58-8e21a12bdf26: deleting Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] group_snapshot 79cc986e-a343-4dc3-9d58-8e21a12bdf26: deleting {{(pid=86459) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Acquiring lock "cinder-quobyte-1c404abe-7ebd-48fd-840f-a86af0ce6465" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Lock "cinder-quobyte-1c404abe-7ebd-48fd-840f-a86af0ce6465" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Acquiring lock "cinder-quobyte-99a3e249-418b-4af1-853f-baf26058e835" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Lock "cinder-quobyte-99a3e249-418b-4af1-853f-baf26058e835" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Deleting offline snapshot 99a3e249-418b-4af1-853f-baf26058e835 of volume 1c404abe-7ebd-48fd-840f-a86af0ce6465 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] snapshot_file for this snap is: volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e9fb45-a710-4f41-98e8-d91f2eb5964b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:01 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 Jul 05 17:27:01 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:01 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b" returned: 0 in 0.837s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43636f1-e5ee-44b3-b50d-f2ab362ada9b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:01 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4" returned: 0 in 0.712s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:01 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.187s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1645825534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ceb08e-9673-4d7a-91be-dc09023eb74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82eadb649fe1484799aee4b07c6c6d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:26:57Z,use_quota=True,user_id='07700a5e5f0c44caa3231ad8090a3a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:27:01 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Creating volume e7ceb08e-9673-4d7a-91be-dc09023eb74b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:27:01 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb25627-53c5-4fc1-a2fd-dcb3c7f385ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1eee7f-d0e8-42b5-ba92-9b35293cf682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:01 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b 1073741824 Jul 05 17:27:01 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:01 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Volume volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 (1f44c83e-3806-41e0-8f36-60d9d77bd6b4): created successfully Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1eee7f-d0e8-42b5-ba92-9b35293cf682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Flow 'volume_create_manager' (be8f58d3-cd26-425f-89b7-8ef81acffa0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:01 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6299f183-82cb-48dd-b723-cd3799ac4ee1 tempest-VolumeTypesAccessTest-1520248634 None] Created volume successfully. Jul 05 17:27:01 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835" returned: 0 in 0.826s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c404abe-7ebd-48fd-840f-a86af0ce6465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aadd37-b7b1-40ab-b372-983a962b1336]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:01 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 Jul 05 17:27:01 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Acquiring lock "cinder-1f44c83e-3806-41e0-8f36-60d9d77bd6b4-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Lock "cinder-1f44c83e-3806-41e0-8f36-60d9d77bd6b4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Acquiring lock "cinder-quobyte-1f44c83e-3806-41e0-8f36-60d9d77bd6b4" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Lock "cinder-quobyte-1f44c83e-3806-41e0-8f36-60d9d77bd6b4" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e90c41-8919-4eef-aaa7-4ea1f1e6f4ed]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:02 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374" returned: 0 in 0.920s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:02 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b Jul 05 17:27:02 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:02 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 Jul 05 17:27:02 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:02 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b 1073741824" returned: 0 in 0.973s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:02 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b Jul 05 17:27:02 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:02 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465" returned: 0 in 0.946s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:02 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 Jul 05 17:27:02 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:02 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4" returned: 0 in 0.881s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:03 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4 Jul 05 17:27:03 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:03 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b" returned: 0 in 0.850s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:03 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b Jul 05 17:27:03 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:03 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b" returned: 0 in 0.752s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df63f89-99ac-4ecf-9498-4fdc1fe5735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ab2f1b-0c18-45af-b7f9-35aa7e7ae97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:03 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Volume volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b (e7ceb08e-9673-4d7a-91be-dc09023eb74b): created successfully Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ab2f1b-0c18-45af-b7f9-35aa7e7ae97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Flow 'volume_create_manager' (2fe992d4-325e-456c-994b-0a8d5671b132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:03 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-98ed3221-fd08-4c95-9e42-46bd13e775fc req-c3555e1f-593b-40f5-b42a-5a68117837a7 tempest-VolumesSnapshotsTestJSON-384091136 None] Created volume successfully. Jul 05 17:27:03 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835" returned: 0 in 0.851s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:03 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835 Jul 05 17:27:03 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:03 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.2c3286b9-0341-45b1-a9d2-e6614f0b737b" returned: 0 in 0.693s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-2c3286b9-0341-45b1-a9d2-e6614f0b737b" released by "_delete_snapshot" :: held 3.405s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" released by "delete_snapshot" :: held 3.435s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:03 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1f44c83e-3806-41e0-8f36-60d9d77bd6b4" returned: 0 in 0.843s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Created reservations ['a9213201-6c35-437c-a35a-02d0ab0f5b0c', 'cf7c8d97-7fe4-4ab1-b47c-c5e73ede19a1', '07bdc479-a14d-4214-86ea-2aa8c1a4fb39', '5b26bc46-4161-43fc-9b5d-b19df3a8674c'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Lock "cinder-quobyte-1f44c83e-3806-41e0-8f36-60d9d77bd6b4" released by "delete_volume" :: held 1.777s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:03 devstack cinder-volume[86459]: WARNING cinder.quota [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2062289435 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2062289435, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:27:03 devstack cinder-volume[86459]: WARNING cinder.quota [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2062289435 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2062289435, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:27:03 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Delete snapshot completed successfully. Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-691aee24-b08f-417f-b2d5-dd6911f75c03 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-2c3286b9-0341-45b1-a9d2-e6614f0b737b-delete_snapshot" released by "delete_snapshot" :: held 3.667s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Created reservations ['7fa36396-a204-4eb6-b407-1096b7ef6069', 'a00b8abb-5f49-43c9-82fb-e47b37501ea9', 'ce666f14-08c9-4c5e-adfa-e943ed4fcbae', '2b2b35a3-32e6-474a-946a-360f48733d0e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Creating offline snapshot 6b1c51ab-244b-48b1-b182-a35763831da3 of volume e7ceb08e-9673-4d7a-91be-dc09023eb74b {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf44d6c3-5fbc-4e6d-9236-d1b45d40074c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:04 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:04 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:04 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b Jul 05 17:27:04 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:04 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465.99a3e249-418b-4af1-853f-baf26058e835" returned: 0 in 0.775s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Lock "cinder-quobyte-99a3e249-418b-4af1-853f-baf26058e835" released by "_delete_snapshot" :: held 3.523s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Lock "cinder-quobyte-1c404abe-7ebd-48fd-840f-a86af0ce6465" released by "delete_snapshot" :: held 3.554s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:04 devstack cinder-volume[86459]: WARNING cinder.quota [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1330482163 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1330482163, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:27:04 devstack cinder-volume[86459]: WARNING cinder.quota [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1330482163 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1330482163, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] Created reservations ['5d6154c8-cf83-41da-94b5-81421f74a095', 'd577ea67-8be3-42e0-bd42-431635a94a11', '54459c7f-91b0-4209-ad30-a415155cbe90', '6dff8083-faf2-418c-9215-f5313ee97f10'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-ec8a93e4-f9a0-4a48-973b-3a17f11ed374-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-ec8a93e4-f9a0-4a48-973b-3a17f11ed374-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-quobyte-ec8a93e4-f9a0-4a48-973b-3a17f11ed374" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0d4eda60-5625-41ae-9495-f4b8d93b47a2 tempest-GroupSnapshotsV319Test-462020523 None] group_snapshot 79cc986e-a343-4dc3-9d58-8e21a12bdf26: deleted successfully Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-ec8a93e4-f9a0-4a48-973b-3a17f11ed374" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Deleting offline snapshot ec8a93e4-f9a0-4a48-973b-3a17f11ed374 of volume 195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] snapshot_file for this snap is: volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec06d6-acf7-47f1-a78a-83973d71166c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:04 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 Jul 05 17:27:04 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:05 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.898s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Deleted volume successfully. Jul 05 17:27:05 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6df1630-70cc-43f5-980a-e63f314630bb tempest-VolumeTypesAccessTest-1520248634 None] Lock "cinder-1f44c83e-3806-41e0-8f36-60d9d77bd6b4-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b" returned: 0 in 0.983s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:05 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 1G Jul 05 17:27:05 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:05 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374" returned: 0 in 0.843s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Acquiring lock "cinder-quobyte-1c404abe-7ebd-48fd-840f-a86af0ce6465" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[675525cd-38c2-42eb-83e5-5270fa0b0882]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Lock "cinder-quobyte-1c404abe-7ebd-48fd-840f-a86af0ce6465" acquired by "delete_volume" :: waited 0.057s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3af9cc9-9763-45a0-8dfa-175e9bb7cbad]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:05 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 Jul 05 17:27:05 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:05 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 Jul 05 17:27:05 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:05 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 1G" returned: 0 in 0.950s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:06 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 Jul 05 17:27:06 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:06 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9" returned: 0 in 0.920s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:06 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 Jul 05 17:27:06 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:06 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465" returned: 0 in 0.976s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:06 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465 Jul 05 17:27:06 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:06 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3" returned: 0 in 0.885s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:06 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 is being set with open permissions: ugo+rw Jul 05 17:27:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:06 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 Jul 05 17:27:06 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:07 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374" returned: 0 in 1.028s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:07 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:07 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3" returned: 0 in 0.771s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1c404abe-7ebd-48fd-840f-a86af0ce6465" returned: 0 in 0.908s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:07 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374 Jul 05 17:27:07 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Lock "cinder-quobyte-1c404abe-7ebd-48fd-840f-a86af0ce6465" released by "delete_volume" :: held 1.982s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:07 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.info Jul 05 17:27:07 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:07 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Created reservations ['ce880d61-0611-4aea-82ed-8777472ddd48'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:07 devstack cinder-volume[86459]: WARNING cinder.quota [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1330482163 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1330482163, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:27:07 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Created reservations ['2759bce7-78fc-4a4a-aa3a-391d43abd17c', 'fc5732f7-6fc7-49f5-bc2f-0c0583b7989f', '4d8ab27d-845f-40de-8b28-3ce442f44cf1', '7d9d50cd-d269-49a7-b59e-ddf29148f505'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:08 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:08 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:08 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9.ec8a93e4-f9a0-4a48-973b-3a17f11ed374" returned: 0 in 0.924s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-ec8a93e4-f9a0-4a48-973b-3a17f11ed374" released by "_delete_snapshot" :: held 3.919s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" released by "delete_snapshot" :: held 3.975s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Created reservations ['1a2e1fac-3cbe-4a9a-a2ae-81e69c35d892', '41183a55-a7cb-45c2-b10f-47b89ed6e080', '8bdf0c1b-c651-4e85-9973-e2fc78948e53', '8b6ccbdf-f3ab-4ba2-8aee-74e42a416947'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:08 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.info" returned: 0 in 1.101s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:08 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.info is being set with open permissions: ugo+rw Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:08 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Delete snapshot completed successfully. Jul 05 17:27:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c8cd1bac-3452-400e-a1d0-19866b8a9bc5 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-ec8a93e4-f9a0-4a48-973b-3a17f11ed374-delete_snapshot" released by "delete_snapshot" :: held 4.284s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:08 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.info Jul 05 17:27:08 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:09 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.012s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3438b263-d545-4d45-ab04-c22f5879c63e tempest-GroupSnapshotsV319Test-462020523 None] Delete group completed successfully. Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-195f3e8f-b04b-4dd0-92c5-44072ac91de9-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-195f3e8f-b04b-4dd0-92c5-44072ac91de9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9afb62-0514-47db-989b-3dba839242b6]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:09 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.info" returned: 0 in 0.804s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.719s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:09 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 Jul 05 17:27:09 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-d47f62f4-4720-417e-93bf-1cc7f4e0c972 req-3812842b-8123-46c5-bbe3-bf1c3a16d738 tempest-VolumesSnapshotsTestJSON-384091136 None] Create snapshot completed successfully Jul 05 17:27:10 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9" returned: 0 in 0.956s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:10 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9 Jul 05 17:27:10 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "cinder-6b1c51ab-244b-48b1-b182-a35763831da3-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-6b1c51ab-244b-48b1-b182-a35763831da3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "cinder-quobyte-e7ceb08e-9673-4d7a-91be-dc09023eb74b" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-quobyte-e7ceb08e-9673-4d7a-91be-dc09023eb74b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "cinder-quobyte-6b1c51ab-244b-48b1-b182-a35763831da3" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-quobyte-6b1c51ab-244b-48b1-b182-a35763831da3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Deleting offline snapshot 6b1c51ab-244b-48b1-b182-a35763831da3 of volume e7ceb08e-9673-4d7a-91be-dc09023eb74b {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:27:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] snapshot_file for this snap is: volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d3e0ab-fa30-46e0-b816-9ef03b0513f6]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:11 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 Jul 05 17:27:11 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:11 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-195f3e8f-b04b-4dd0-92c5-44072ac91de9" returned: 0 in 0.864s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-quobyte-195f3e8f-b04b-4dd0-92c5-44072ac91de9" released by "delete_volume" :: held 1.897s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Created reservations ['cb0daefd-41b7-4d30-97d9-1029c80915d3', '2ece16f6-05b2-4c6b-bb87-92bd44336c21', '6dddec43-7c93-4059-8c43-97dcbc14aa5d', '63b57474-04c7-4310-aaae-a3843d5625e7'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:11 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:11 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:12 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3" returned: 0 in 1.043s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:27:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f93acb-4f40-4045-8d2d-a399d36111e8]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:12 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b Jul 05 17:27:12 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:12 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.895s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:12 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Deleted volume successfully. Jul 05 17:27:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e13e584-17b7-4a02-8d72-eae684976154 tempest-VolumesSnapshotListTestJSON-1664448703 None] Lock "cinder-195f3e8f-b04b-4dd0-92c5-44072ac91de9-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:13 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b" returned: 0 in 1.045s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:13 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 Jul 05 17:27:13 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:14 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3" returned: 0 in 1.019s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:14 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3 Jul 05 17:27:14 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:14 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b.6b1c51ab-244b-48b1-b182-a35763831da3" returned: 0 in 0.731s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:14 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-quobyte-6b1c51ab-244b-48b1-b182-a35763831da3" released by "_delete_snapshot" :: held 3.994s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:14 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-quobyte-e7ceb08e-9673-4d7a-91be-dc09023eb74b" released by "delete_snapshot" :: held 4.026s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:15 devstack cinder-volume[86459]: DEBUG cinder.quota [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Created reservations ['1c39ce28-ec94-4770-a126-ef726dfac782', 'd823f077-2165-43f1-be58-2d988b309c8e', 'be5e4c57-8572-4442-af09-4c18c9566c6b', 'e9cbb35f-44c3-4682-87fe-2aece0fb7cfe'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:15 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Delete snapshot completed successfully. Jul 05 17:27:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-03f36d7f-f407-4e3a-a42b-69d720fd123d req-a9d22bc6-d283-43e4-915a-9b5ef50746f8 tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-6b1c51ab-244b-48b1-b182-a35763831da3-delete_snapshot" released by "delete_snapshot" :: held 4.200s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "cinder-e7ceb08e-9673-4d7a-91be-dc09023eb74b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-e7ceb08e-9673-4d7a-91be-dc09023eb74b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "cinder-quobyte-e7ceb08e-9673-4d7a-91be-dc09023eb74b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-quobyte-e7ceb08e-9673-4d7a-91be-dc09023eb74b" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:15 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc3dbf4-4972-4cca-ab6c-8b7846b1264a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:16 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b Jul 05 17:27:16 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Flow 'volume_create_manager' (8a89faac-aa63-4134-8442-b48e099f55bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7fafd6-00bb-4aa4-b95a-661ea84a079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7fafd6-00bb-4aa4-b95a-661ea84a079c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-334632787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dfcb66-bf81-4de5-85f3-57b0a2bab3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82acffd85a6c4f108769ce13f6a53f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:16Z,use_quota=True,user_id='543470f0b72b4a4f9989c4e109c41893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6847f932-b0d2-4aba-9c25-ec34077aec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6847f932-b0d2-4aba-9c25-ec34077aec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77765d07-a159-4e91-bfbc-e8d2dc560da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77765d07-a159-4e91-bfbc-e8d2dc560da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63dfcb66-bf81-4de5-85f3-57b0a2bab3c0', 'volume_name': 'volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0', 'volume_size': 2}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764eeb6e-464c-4d06-9c21-731624f05ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764eeb6e-464c-4d06-9c21-731624f05ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3ccbd0-32ad-4d4c-b8aa-28801a78ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:16 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Volume 63dfcb66-bf81-4de5-85f3-57b0a2bab3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0', 'volume_size': 2} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-334632787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dfcb66-bf81-4de5-85f3-57b0a2bab3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82acffd85a6c4f108769ce13f6a53f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:16Z,use_quota=True,user_id='543470f0b72b4a4f9989c4e109c41893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Creating volume 63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:27:16 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 2147483648 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:16 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 2147483648 Jul 05 17:27:16 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:16 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b" returned: 0 in 1.012s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:16 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b Jul 05 17:27:16 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:17 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7ceb08e-9673-4d7a-91be-dc09023eb74b" returned: 0 in 1.101s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:18 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 2147483648" returned: 0 in 1.335s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-quobyte-e7ceb08e-9673-4d7a-91be-dc09023eb74b" released by "delete_volume" :: held 2.237s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:18 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 Jul 05 17:27:18 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.quota [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Created reservations ['a6212806-a772-4875-aa8a-e837196df285', '3a6085a3-8d73-4623-a1eb-c2677e9bc0f9', '7c73b065-e6ae-435d-b329-fd6c6c5f3d78', '53e094f7-7eef-4aa1-b1a6-5ae631c934d8'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:18 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:18 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:18 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" returned: 0 in 0.833s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3ccbd0-32ad-4d4c-b8aa-28801a78ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0', 'volume_size': 2}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e003d38b-70e6-4860-8506-56c8d5db57a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:18 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Volume volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 (63dfcb66-bf81-4de5-85f3-57b0a2bab3c0): created successfully Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e003d38b-70e6-4860-8506-56c8d5db57a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Flow 'volume_create_manager' (8a89faac-aa63-4134-8442-b48e099f55bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c50be33d-af5a-4d53-8846-d93a3cbc2560 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Created volume successfully. Jul 05 17:27:19 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.788s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:19 devstack cinder-volume[86459]: DEBUG cinder.manager [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Deleted volume successfully. Jul 05 17:27:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-8b4989a9-e7ee-42e4-85fb-a5f6e2a89d1c req-ed93ff94-dd4a-49c9-9e91-1c0fff1c577f tempest-VolumesSnapshotsTestJSON-384091136 None] Lock "cinder-e7ceb08e-9673-4d7a-91be-dc09023eb74b-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Flow 'volume_create_manager' (50ed1a30-81bf-4078-bfb7-6a00a21eaa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9ff138-55bb-4ec7-b214-5b65e83d8a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Creating offline snapshot ed474bf7-8907-443e-ab90-961426d5179e of volume 63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9ff138-55bb-4ec7-b214-5b65e83d8a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-661818521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8914ab4-0d2a-4d40-a955-cc5656018f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ccb2829a54b40acaa60079e56af3d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:20Z,use_quota=True,user_id='3e512be493a649fc8a5279a185f0b8e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107e08c5-500b-4377-8857-88fafee3ffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107e08c5-500b-4377-8857-88fafee3ffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891d827a-2501-4bbd-846f-12dd53387402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fff164-cafa-4ebe-9142-44da97ad5a5b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:20 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 Jul 05 17:27:20 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891d827a-2501-4bbd-846f-12dd53387402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8914ab4-0d2a-4d40-a955-cc5656018f07', 'volume_name': 'volume-e8914ab4-0d2a-4d40-a955-cc5656018f07', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17addd46-8077-421b-bb38-6871df9393c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17addd46-8077-421b-bb38-6871df9393c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b1e015-c324-43ce-8c6b-7e0b1f15ecb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:20 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Volume e8914ab4-0d2a-4d40-a955-cc5656018f07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8914ab4-0d2a-4d40-a955-cc5656018f07', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 17:27:20 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Trying to clone e8914ab4-0d2a-4d40-a955-cc5656018f07 from image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:27:21 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" returned: 0 in 1.120s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e 2G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:21 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e 2G Jul 05 17:27:21 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:21 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:27:21 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Image download 20.69 MB at 20.69 MB/s Jul 05 17:27:21 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f61dd-2185-4b76-b1c9-3484dd201efa]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:21 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD Jul 05 17:27:21 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:22 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e 2G" returned: 0 in 1.078s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:22 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD" returned: 0 in 0.917s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:22 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Temporary image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 is fetched for user 3e512be493a649fc8a5279a185f0b8e8. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:27:22 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e Jul 05 17:27:22 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:22 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0af04e-52b9-4d59-aa09-20f8a9dca84d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:22 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD Jul 05 17:27:22 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:23 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e" returned: 0 in 0.977s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:23 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e is being set with open permissions: ugo+rw Jul 05 17:27:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:23 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e Jul 05 17:27:23 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:23 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD" returned: 0 in 1.020s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:24 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e" returned: 0 in 0.727s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:24 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.info Jul 05 17:27:24 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:24 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.info" returned: 0 in 0.673s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:24 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.info is being set with open permissions: ugo+rw Jul 05 17:27:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:24 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.info Jul 05 17:27:24 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:25 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.info" returned: 0 in 0.693s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.430s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.997s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-661818521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8914ab4-0d2a-4d40-a955-cc5656018f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ccb2829a54b40acaa60079e56af3d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:20Z,use_quota=True,user_id='3e512be493a649fc8a5279a185f0b8e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Creating volume e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:27:25 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:27:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:25 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 1073741824 Jul 05 17:27:25 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d36eb14f-949d-44b6-9b97-ed5ce7c32a4f tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Create snapshot completed successfully Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "cinder-ed474bf7-8907-443e-ab90-961426d5179e-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-ed474bf7-8907-443e-ab90-961426d5179e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "cinder-quobyte-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-quobyte-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "cinder-quobyte-ed474bf7-8907-443e-ab90-961426d5179e" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-quobyte-ed474bf7-8907-443e-ab90-961426d5179e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Deleting offline snapshot ed474bf7-8907-443e-ab90-961426d5179e of volume 63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:27:26 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] snapshot_file for this snap is: volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 1073741824" returned: 0 in 1.074s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fdea63-864b-4c76-bf04-62bdd0f6fd7b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:26 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 Jul 05 17:27:26 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:26 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e Jul 05 17:27:26 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:27 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07" returned: 0 in 0.826s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Attempting download of ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}])) to volume e8914ab4-0d2a-4d40-a955-cc5656018f07. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e966250f-5a91-48db-8d74-71a8d007e82b]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_e1z2vask {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:27 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e" returned: 0 in 1.144s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:27:27 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_e1z2vask Jul 05 17:27:27 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e28307-2bce-4b0b-a5f2-8f4498c881c6]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:28 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 Jul 05 17:27:28 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:28 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_e1z2vask" returned: 0 in 1.036s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_e1z2vask {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:28 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" returned: 0 in 0.987s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:28 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_e1z2vask Jul 05 17:27:28 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:28 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e Jul 05 17:27:28 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:29 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_e1z2vask" returned: 1 in 0.839s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_e1z2vask' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:27:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[19807e6f-d0c1-4252-a4f9-b9b20079182b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:29 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD Jul 05 17:27:29 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:29 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e" returned: 0 in 0.898s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:29 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e Jul 05 17:27:29 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:30 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0.ed474bf7-8907-443e-ab90-961426d5179e" returned: 0 in 0.690s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:30 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:INSERT=47,cinder:UPDATE=154,cinder:SELECT=146,cinder:DELETE=5 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=136,cinder:INSERT=39,cinder:UPDATE=176,cinder:DELETE=15 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 was qcow2, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:30 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 Jul 05 17:27:30 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-quobyte-ed474bf7-8907-443e-ab90-961426d5179e" released by "_delete_snapshot" :: held 3.909s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-quobyte-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" released by "delete_snapshot" :: held 3.957s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Created reservations ['1d232a04-b78f-475f-9b66-2a4bb0c6c8e8', '36c4cda9-e2fa-4d36-834c-dd867630b5c2', 'b2a96d7a-0883-4471-91e1-9423462df443', '87c19a61-ef56-4578-a86e-c84864c0b503'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:30 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Delete snapshot completed successfully. Jul 05 17:27:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-470fea21-5f61-411b-a747-e1727b684887 tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-ed474bf7-8907-443e-ab90-961426d5179e-delete_snapshot" released by "delete_snapshot" :: held 4.113s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "cinder-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "cinder-quobyte-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-quobyte-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ca0cbb-25e5-4a4d-a023-3003a6f1316b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:31 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 Jul 05 17:27:31 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Flow 'volume_create_manager' (bbe446eb-3555-4116-831f-33e1ec785f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be905b6-96d9-41b0-b9bc-8092c4b2a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be905b6-96d9-41b0-b9bc-8092c4b2a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1259887358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb755e7-3843-46c7-99b9-c93d404ab992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4482a55b9994184bf6831ceeec01520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:32Z,use_quota=True,user_id='a87376916cf84df5aed47845f5e1abe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959ab003-b170-4105-9418-92e35b861215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959ab003-b170-4105-9418-92e35b861215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e8696f-35ff-4cec-aa8e-6b750129b78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e8696f-35ff-4cec-aa8e-6b750129b78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb755e7-3843-46c7-99b9-c93d404ab992', 'volume_name': 'volume-9bb755e7-3843-46c7-99b9-c93d404ab992', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c231afa-1358-4739-a362-0108be814811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c231afa-1358-4739-a362-0108be814811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dba04a4-41b2-47a2-98ca-32c6b26604b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:31 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Volume 9bb755e7-3843-46c7-99b9-c93d404ab992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb755e7-3843-46c7-99b9-c93d404ab992', 'volume_size': 1} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1259887358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb755e7-3843-46c7-99b9-c93d404ab992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4482a55b9994184bf6831ceeec01520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:32Z,use_quota=True,user_id='a87376916cf84df5aed47845f5e1abe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Creating volume 9bb755e7-3843-46c7-99b9-c93d404ab992 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:27:31 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:27:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:31 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 1073741824 Jul 05 17:27:31 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:32 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" returned: 0 in 1.128s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:32 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0 Jul 05 17:27:32 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:32 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 1073741824" returned: 0 in 1.151s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:32 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 Jul 05 17:27:32 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:32 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07" returned: 0 in 2.527s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:32 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_rzsx6_xzdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:27:32 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Converted 112.00 MB image at 44.29 MB/s Jul 05 17:27:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:33 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 1G Jul 05 17:27:33 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:33 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" returned: 0 in 0.799s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-quobyte-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0" released by "delete_volume" :: held 2.012s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Created reservations ['db29dc70-830f-4dd8-9541-ffb97cf5d4dc', '8ef0056c-c86c-45c7-90bf-3958d826e008', 'a8a45a34-e265-4797-b1b9-b27038c592e0', '576bcdf8-1bee-4599-9f9b-a1216fdf4cf0'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:33 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:33 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:33 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 1G" returned: 0 in 0.992s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[4332abd6-d4bf-4867-96f4-6ea5010fb7d1]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:34 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992" returned: 0 in 1.157s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dba04a4-41b2-47a2-98ca-32c6b26604b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb755e7-3843-46c7-99b9-c93d404ab992', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3757265f-841a-4a4f-b410-54bc386eb27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Volume volume-9bb755e7-3843-46c7-99b9-c93d404ab992 (9bb755e7-3843-46c7-99b9-c93d404ab992): created successfully Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3757265f-841a-4a4f-b410-54bc386eb27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Flow 'volume_create_manager' (bbe446eb-3555-4116-831f-33e1ec785f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6d5206f4-93d7-40ca-b8b7-f968d13cf7aa tempest-VolumeQuotasNegativeTestJSON-750434383 None] Created volume successfully. Jul 05 17:27:34 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 Jul 05 17:27:34 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:34 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.946s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Deleted volume successfully. Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5496080c-2d9c-40a9-8f17-7e48e772bc5a tempest-VolumesSnapshotNegativeTestJSON-1968954573 None] Lock "cinder-63dfcb66-bf81-4de5-85f3-57b0a2bab3c0-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:34 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07" returned: 0 in 0.927s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:35 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 Jul 05 17:27:35 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:35 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07" returned: 1 in 1.010s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:27:35 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Downloaded image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}])) to volume e8914ab4-0d2a-4d40-a955-cc5656018f07 successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:27:35 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Temporary image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 for user 3e512be493a649fc8a5279a185f0b8e8 is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:27:35 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Marking volume e8914ab4-0d2a-4d40-a955-cc5656018f07 as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:27:35 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Copying metadata from image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 to e8914ab4-0d2a-4d40-a955-cc5656018f07. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:27:35 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Creating volume glance metadata for volume e8914ab4-0d2a-4d40-a955-cc5656018f07 backed by image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Acquiring lock "cinder-9bb755e7-3843-46c7-99b9-c93d404ab992-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "cinder-9bb755e7-3843-46c7-99b9-c93d404ab992-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b1e015-c324-43ce-8c6b-7e0b1f15ecb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8914ab4-0d2a-4d40-a955-cc5656018f07', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4981e31-efc2-49db-9348-f72a1ddb5b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:36 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Volume volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 (e8914ab4-0d2a-4d40-a955-cc5656018f07): created successfully Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4981e31-efc2-49db-9348-f72a1ddb5b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Flow 'volume_create_manager' (50ed1a30-81bf-4078-bfb7-6a00a21eaa77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Acquiring lock "cinder-quobyte-9bb755e7-3843-46c7-99b9-c93d404ab992" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ea84aa30-030f-44b0-9070-8b82b41357f3 tempest-VolumesImageMetadata-1181356175 None] Created volume successfully. Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "cinder-quobyte-9bb755e7-3843-46c7-99b9-c93d404ab992" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee15cb68-ab4b-4f36-93ec-6322ffe511ec]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:36 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 Jul 05 17:27:36 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Acquiring lock "cinder-e8914ab4-0d2a-4d40-a955-cc5656018f07-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Lock "cinder-e8914ab4-0d2a-4d40-a955-cc5656018f07-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Acquiring lock "cinder-quobyte-e8914ab4-0d2a-4d40-a955-cc5656018f07" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Lock "cinder-quobyte-e8914ab4-0d2a-4d40-a955-cc5656018f07" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d8d21-08be-4df0-a10a-480eb18cbc2a]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:37 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992" returned: 0 in 1.056s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:37 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 Jul 05 17:27:37 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:37 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992 Jul 05 17:27:37 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Flow 'volume_create_manager' (7cc6ea23-e084-4908-a9ab-966028c4b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05f32b1-a953-40af-b63c-1aa86cb414a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05f32b1-a953-40af-b63c-1aa86cb414a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-309744443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d969f1-c402-4f88-a531-da721923bc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8ae4de9767437a94d016721965bb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:38Z,use_quota=True,user_id='800b625f66704f9d88551a18bad55ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72ef96f-89b3-4c29-a2d7-33dd86f92726),volume_type_id=e72ef96f-89b3-4c29-a2d7-33dd86f92726)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e324a8c-43d3-48d9-bd1d-f7691a8e19ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e324a8c-43d3-48d9-bd1d-f7691a8e19ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ed8a78-3735-4706-a584-a856ede53465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ed8a78-3735-4706-a584-a856ede53465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d969f1-c402-4f88-a531-da721923bc28', 'volume_name': 'volume-95d969f1-c402-4f88-a531-da721923bc28', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aebe063-2fa0-44f4-9554-dd8711db7b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aebe063-2fa0-44f4-9554-dd8711db7b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748cabdc-895c-4ab1-93ea-8d1ea89bb031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:38 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Volume 95d969f1-c402-4f88-a531-da721923bc28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d969f1-c402-4f88-a531-da721923bc28', 'volume_size': 1} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-309744443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d969f1-c402-4f88-a531-da721923bc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8ae4de9767437a94d016721965bb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:38Z,use_quota=True,user_id='800b625f66704f9d88551a18bad55ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72ef96f-89b3-4c29-a2d7-33dd86f92726),volume_type_id=e72ef96f-89b3-4c29-a2d7-33dd86f92726)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Creating volume 95d969f1-c402-4f88-a531-da721923bc28 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:27:38 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:38 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 1073741824 Jul 05 17:27:38 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:38 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-9bb755e7-3843-46c7-99b9-c93d404ab992" returned: 0 in 0.891s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "cinder-quobyte-9bb755e7-3843-46c7-99b9-c93d404ab992" released by "delete_volume" :: held 1.996s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Created reservations ['f40f9ef1-0292-4d0f-a154-305d0737098a', 'db65c645-d41c-47e4-b9ca-efa472bbfe9f', '5b3adb91-42df-4ec7-80dd-ef915b1eecb7', '4f46ec84-3b59-498b-bdfe-834e6e3e0051'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:38 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07" returned: 0 in 1.253s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:38 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:38 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:38 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 Jul 05 17:27:38 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:39 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 1073741824" returned: 0 in 1.114s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:39 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.858s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:39 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:39 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Deleted volume successfully. Jul 05 17:27:39 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 Jul 05 17:27:39 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-dfbcef61-7593-478e-944f-051a59dac49c tempest-VolumeQuotasNegativeTestJSON-750434383 None] Lock "cinder-9bb755e7-3843-46c7-99b9-c93d404ab992-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:39 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07" returned: 1 in 0.911s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:27:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:39 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07 Jul 05 17:27:39 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:40 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28" returned: 0 in 0.822s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748cabdc-895c-4ab1-93ea-8d1ea89bb031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d969f1-c402-4f88-a531-da721923bc28', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:40 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61c82ce-afdd-4554-a8d6-f603b69be9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e8914ab4-0d2a-4d40-a955-cc5656018f07" returned: 0 in 0.794s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Volume volume-95d969f1-c402-4f88-a531-da721923bc28 (95d969f1-c402-4f88-a531-da721923bc28): created successfully Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61c82ce-afdd-4554-a8d6-f603b69be9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Flow 'volume_create_manager' (7cc6ea23-e084-4908-a9ab-966028c4b21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Lock "cinder-quobyte-e8914ab4-0d2a-4d40-a955-cc5656018f07" released by "delete_volume" :: held 3.076s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-22466a58-0438-4f4b-b15d-62fb85830362 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Created volume successfully. Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Created reservations ['a7eb511e-29d8-4cb2-8807-5b8518d6ec30', 'fefc3aec-69ec-4079-89d0-8028a8f6b4b3', '93d9a24d-e9f7-49fb-b0ac-2a06501aa6fd', 'f69c14cb-d50b-4b29-9276-15d9bbe14b11'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:40 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:40 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:41 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.878s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Deleted volume successfully. Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c1563b7-8f54-407a-af0e-f90518dd7be6 tempest-VolumesImageMetadata-1181356175 None] Lock "cinder-e8914ab4-0d2a-4d40-a955-cc5656018f07-delete_volume" released by "delete_volume" :: held 4.247s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:41 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:41 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:42 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.801s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:42 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-929bbe09-8b7f-4ab6-a29c-73f3118d4a2f tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Retype volume completed successfully. Jul 05 17:27:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Acquiring lock "cinder-95d969f1-c402-4f88-a531-da721923bc28-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "cinder-95d969f1-c402-4f88-a531-da721923bc28-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Acquiring lock "cinder-quobyte-95d969f1-c402-4f88-a531-da721923bc28" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "cinder-quobyte-95d969f1-c402-4f88-a531-da721923bc28" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:43 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[99133d2a-6153-4d4d-8bbf-dc9e87613fd4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:43 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 Jul 05 17:27:43 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:44 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28" returned: 0 in 1.190s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:44 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28 Jul 05 17:27:44 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:45 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-95d969f1-c402-4f88-a531-da721923bc28" returned: 0 in 0.801s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "cinder-quobyte-95d969f1-c402-4f88-a531-da721923bc28" released by "delete_volume" :: held 2.051s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:45 devstack cinder-volume[86459]: WARNING cinder.quota [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:27:45 devstack cinder-volume[86459]: WARNING cinder.quota [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Created reservations ['0a948b47-8fac-4b30-a6ad-cb84020d7a3f', 'b41bd671-a77b-43b6-9ea2-1841f8f36f33', 'f9275f70-2d12-42f4-bcbf-769845547e23', 'fbf4eda9-4bf6-4a49-afb1-7d4c49ea80f0'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:45 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:45 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Flow 'volume_create_manager' (744ba2ab-78d7-43f4-9ef8-6e01e703ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcfade1-03bd-4efb-b1ee-a2340b52e3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcfade1-03bd-4efb-b1ee-a2340b52e3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-644671285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f5e803-bbb2-4bfb-8698-66bfc5744d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ffe23ad27449ef9f5058fe32cffb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:46Z,use_quota=True,user_id='ee70dea9fa5f4ace9f6d88a412310c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc97b4ab-45e8-455c-9ef0-e8abfd826f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc97b4ab-45e8-455c-9ef0-e8abfd826f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74c07f4-a5ed-4543-8a97-44eb3c933016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74c07f4-a5ed-4543-8a97-44eb3c933016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f5e803-bbb2-4bfb-8698-66bfc5744d43', 'volume_name': 'volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1bd068-399b-4982-877b-b84e78675105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1bd068-399b-4982-877b-b84e78675105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e59080-42e0-4a13-b3ab-e6911dc09dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:46 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Volume e7f5e803-bbb2-4bfb-8698-66bfc5744d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43', 'volume_size': 1} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-644671285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f5e803-bbb2-4bfb-8698-66bfc5744d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ffe23ad27449ef9f5058fe32cffb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:46Z,use_quota=True,user_id='ee70dea9fa5f4ace9f6d88a412310c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Creating volume e7f5e803-bbb2-4bfb-8698-66bfc5744d43 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:27:46 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:46 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 1073741824 Jul 05 17:27:46 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:46 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.989s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Deleted volume successfully. Jul 05 17:27:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b965be78-335c-4e1f-8539-fbcaf4514c18 tempest-VolumeRetypeWithoutMigrationTest-134878375 None] Lock "cinder-95d969f1-c402-4f88-a531-da721923bc28-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:27:47 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 1073741824" returned: 0 in 1.390s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:47 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 Jul 05 17:27:47 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:48 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" returned: 0 in 0.778s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:27:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e59080-42e0-4a13-b3ab-e6911dc09dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb01ee9-a95b-4743-a7e7-26997b0dae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:48 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Volume volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 (e7f5e803-bbb2-4bfb-8698-66bfc5744d43): created successfully Jul 05 17:27:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb01ee9-a95b-4743-a7e7-26997b0dae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Flow 'volume_create_manager' (744ba2ab-78d7-43f4-9ef8-6e01e703ab84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-12d2b8ac-7ef4-406e-9720-9bd4fb98b176 tempest-SnapshotMetadataTestJSON-2086630664 None] Created volume successfully. Jul 05 17:27:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Creating offline snapshot a82b7271-1704-4ce8-aa45-f63a5223a1c0 of volume e7f5e803-bbb2-4bfb-8698-66bfc5744d43 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:27:49 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8065d15-761d-4c14-af1f-4b4bcca1feb1]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:49 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 Jul 05 17:27:49 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:50 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" returned: 0 in 1.168s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:50 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 1G Jul 05 17:27:50 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Flow 'volume_create_manager' (cd904fe1-8246-45ad-899a-0d647bc19491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffe7e5d-bbd7-4d98-a5aa-7e8d9cdb4dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffe7e5d-bbd7-4d98-a5aa-7e8d9cdb4dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1407565784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d5d9de-7e72-4216-ac78-f6dbf9d9b024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124273e35ecc402dbdd3caa96175e86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:51Z,use_quota=True,user_id='0fc69ed8abd94357b9b1f104e2a18d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73aacb3-8244-46f2-9333-3f8402c1169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73aacb3-8244-46f2-9333-3f8402c1169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cd83f9-43f1-4134-ae46-570b7bc33d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cd83f9-43f1-4134-ae46-570b7bc33d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d5d9de-7e72-4216-ac78-f6dbf9d9b024', 'volume_name': 'volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38da6261-2f93-4748-91ad-d55101f9f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38da6261-2f93-4748-91ad-d55101f9f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4605395-dda6-449e-b2f4-46e5ab81fc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:50 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Volume 41d5d9de-7e72-4216-ac78-f6dbf9d9b024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024', 'volume_size': 1} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:50 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:27:50 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:51 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.865s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:27:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:27:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:27:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:27:51 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 1G" returned: 0 in 1.122s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:51 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 Jul 05 17:27:51 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:52 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0" returned: 0 in 0.767s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:52 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 is being set with open permissions: ugo+rw Jul 05 17:27:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:52 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 Jul 05 17:27:52 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:53 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0" returned: 0 in 0.693s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:53 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.info Jul 05 17:27:53 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:53 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.info" returned: 0 in 0.757s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:53 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.info is being set with open permissions: ugo+rw Jul 05 17:27:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:54 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.info Jul 05 17:27:54 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:54 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.info" returned: 0 in 0.870s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.489s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.086s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1407565784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d5d9de-7e72-4216-ac78-f6dbf9d9b024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124273e35ecc402dbdd3caa96175e86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:27:51Z,use_quota=True,user_id='0fc69ed8abd94357b9b1f104e2a18d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Creating volume 41d5d9de-7e72-4216-ac78-f6dbf9d9b024 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:27:54 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:27:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:54 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 1073741824 Jul 05 17:27:54 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3f666dd2-72e3-4714-b13e-4df4ce3c9b55 tempest-SnapshotMetadataTestJSON-2086630664 None] Create snapshot completed successfully Jul 05 17:27:56 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 1073741824" returned: 0 in 1.245s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:56 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 Jul 05 17:27:56 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "cinder-a82b7271-1704-4ce8-aa45-f63a5223a1c0-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-a82b7271-1704-4ce8-aa45-f63a5223a1c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "cinder-quobyte-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-quobyte-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "cinder-quobyte-a82b7271-1704-4ce8-aa45-f63a5223a1c0" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-quobyte-a82b7271-1704-4ce8-aa45-f63a5223a1c0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Deleting offline snapshot a82b7271-1704-4ce8-aa45-f63a5223a1c0 of volume e7f5e803-bbb2-4bfb-8698-66bfc5744d43 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:27:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] snapshot_file for this snap is: volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed250b8f-4a13-4ea9-842e-0d570df8b24f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:57 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" returned: 0 in 0.894s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4605395-dda6-449e-b2f4-46e5ab81fc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fe1767-378c-4c81-a7e5-5534a2611ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:27:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Volume volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 (41d5d9de-7e72-4216-ac78-f6dbf9d9b024): created successfully Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fe1767-378c-4c81-a7e5-5534a2611ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:27:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Flow 'volume_create_manager' (cd904fe1-8246-45ad-899a-0d647bc19491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:27:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7212c571-dc97-46fd-af42-0d999162de53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Created volume successfully. Jul 05 17:27:57 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 Jul 05 17:27:57 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0" returned: 0 in 1.017s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:27:58 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7955b2e3-9295-40b4-968f-d1e4a0126d4f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:58 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 Jul 05 17:27:58 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Creating offline snapshot bec40840-cc76-4752-abae-f104abd9908c of volume 41d5d9de-7e72-4216-ac78-f6dbf9d9b024 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbe8e2d-071e-44b3-95ba-c4b671b15d0f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:27:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:58 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 Jul 05 17:27:58 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:59 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" returned: 0 in 1.005s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:59 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 Jul 05 17:27:59 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:59 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" returned: 0 in 0.984s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:27:59 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c 1G Jul 05 17:27:59 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:27:59 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 05 17:27:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0" returned: 0 in 0.903s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:27:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:00 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0 Jul 05 17:28:00 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:00 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c 1G" returned: 0 in 1.033s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:00 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c Jul 05 17:28:00 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:00 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43.a82b7271-1704-4ce8-aa45-f63a5223a1c0" returned: 0 in 0.834s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-quobyte-a82b7271-1704-4ce8-aa45-f63a5223a1c0" released by "_delete_snapshot" :: held 3.959s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-quobyte-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" released by "delete_snapshot" :: held 3.997s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:00 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Created reservations ['2e4793f8-a2b3-41a2-a069-c8e4318153d7', 'a9578d18-b363-495f-bc74-63133868559d', '86a4cd02-e54f-453b-8f63-54c15db80869', 'f232796a-5cb8-4096-a2be-b7746e5c89a8'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:28:01 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Delete snapshot completed successfully. Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548ce59e-a687-41b4-87ff-8e2e8195199e tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-a82b7271-1704-4ce8-aa45-f63a5223a1c0-delete_snapshot" released by "delete_snapshot" :: held 4.203s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "cinder-e7f5e803-bbb2-4bfb-8698-66bfc5744d43-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-e7f5e803-bbb2-4bfb-8698-66bfc5744d43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "cinder-quobyte-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-quobyte-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edecf53-e5e5-44ec-8cab-49e33b01256f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:01 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 Jul 05 17:28:01 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:01 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c" returned: 0 in 1.097s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:01 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c is being set with open permissions: ugo+rw Jul 05 17:28:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:01 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c Jul 05 17:28:01 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:02 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" returned: 0 in 0.934s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:02 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43 Jul 05 17:28:02 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:02 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c" returned: 0 in 0.812s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:02 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.info Jul 05 17:28:02 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:03 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" returned: 0 in 0.863s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-quobyte-e7f5e803-bbb2-4bfb-8698-66bfc5744d43" released by "delete_volume" :: held 1.895s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:03 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.info" returned: 0 in 0.823s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:03 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.info is being set with open permissions: ugo+rw Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Created reservations ['8a230e37-f044-492e-9562-79a3a91ffca1', 'e466973a-42b4-41ea-8e13-b8a4c9072028', 'aae98e0b-8bd5-42b8-bddc-90ab7fb58037', '3d5b8bb1-334c-4857-80cb-787b4073d7fc'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:28:03 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.info Jul 05 17:28:03 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:03 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:28:03 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:04 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.info" returned: 0 in 0.989s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.858s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-724bbc75-8076-4143-9941-18dde5c802c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Create snapshot completed successfully Jul 05 17:28:04 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.983s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:04 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:28:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Deleted volume successfully. Jul 05 17:28:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b2cd4d3-cca1-413a-9d27-593fa4deac68 tempest-SnapshotMetadataTestJSON-2086630664 None] Lock "cinder-e7f5e803-bbb2-4bfb-8698-66bfc5744d43-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "cinder-bec40840-cc76-4752-abae-f104abd9908c-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-bec40840-cc76-4752-abae-f104abd9908c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "cinder-quobyte-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-quobyte-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "cinder-quobyte-bec40840-cc76-4752-abae-f104abd9908c" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-quobyte-bec40840-cc76-4752-abae-f104abd9908c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Deleting offline snapshot bec40840-cc76-4752-abae-f104abd9908c of volume 41d5d9de-7e72-4216-ac78-f6dbf9d9b024 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] snapshot_file for this snap is: volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba1dc44-90eb-4e25-b087-2acbe8daa9cb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:05 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c Jul 05 17:28:05 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:06 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c" returned: 0 in 0.980s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:28:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ea7489-7c03-41f7-912f-3154954ad194]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:07 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 Jul 05 17:28:07 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:07 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" returned: 0 in 1.060s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:07 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c Jul 05 17:28:07 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:09 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c" returned: 0 in 1.190s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:09 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c Jul 05 17:28:09 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:09 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:28:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Flow 'volume_create_manager' (3fb9e713-2211-404f-9cfa-e452f5f22040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98f0889-eafe-4270-aa34-5f25616a74af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98f0889-eafe-4270-aa34-5f25616a74af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2120033014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dc98e7-3320-4dc7-93d2-57f0e946dac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11bd75911334476f97e5e0cf39170603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:10Z,use_quota=True,user_id='da42cfc79af04fda81f1bdae4505acd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e070ba40-44bc-4e05-8f38-af0a729ab63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e070ba40-44bc-4e05-8f38-af0a729ab63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30605988-9c2b-4e02-a432-8150b400de8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30605988-9c2b-4e02-a432-8150b400de8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69dc98e7-3320-4dc7-93d2-57f0e946dac0', 'volume_name': 'volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22eae3c7-2b9d-4900-a018-e59239347508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22eae3c7-2b9d-4900-a018-e59239347508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18f27dd-9152-4d03-be1e-864e9f64b612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:10 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Volume 69dc98e7-3320-4dc7-93d2-57f0e946dac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0', 'volume_size': 1} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2120033014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dc98e7-3320-4dc7-93d2-57f0e946dac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11bd75911334476f97e5e0cf39170603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:10Z,use_quota=True,user_id='da42cfc79af04fda81f1bdae4505acd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Creating volume 69dc98e7-3320-4dc7-93d2-57f0e946dac0 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:28:10 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:10 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 1073741824 Jul 05 17:28:10 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:10 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024.bec40840-cc76-4752-abae-f104abd9908c" returned: 0 in 1.006s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-quobyte-bec40840-cc76-4752-abae-f104abd9908c" released by "_delete_snapshot" :: held 4.558s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-quobyte-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" released by "delete_snapshot" :: held 4.588s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Created reservations ['08bc4a8f-ec2f-4f47-a61d-a291835da7a0', '2c90ba87-1eb6-4351-93ec-d3aa8d2362f2', '25efc931-3428-4781-aabf-f0980bd5a431', '29abb814-f3f7-4c9e-9c3b-104e88be51bb'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:28:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Delete snapshot completed successfully. Jul 05 17:28:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c760e3e8-03ff-499e-98da-71e795a0f19a tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-bec40840-cc76-4752-abae-f104abd9908c-delete_snapshot" released by "delete_snapshot" :: held 4.831s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "cinder-41d5d9de-7e72-4216-ac78-f6dbf9d9b024-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-41d5d9de-7e72-4216-ac78-f6dbf9d9b024-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "cinder-quobyte-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:11 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 1073741824" returned: 0 in 1.241s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-quobyte-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" acquired by "delete_volume" :: waited 0.035s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:11 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b277e6cd-da34-44fc-8b02-f8ab5b877a7c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:11 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 Jul 05 17:28:11 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:11 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 Jul 05 17:28:11 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:12 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0" returned: 0 in 1.057s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:12 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18f27dd-9152-4d03-be1e-864e9f64b612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61780140-1fee-4299-b501-8e4e2942e09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" returned: 0 in 1.124s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:12 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Volume volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 (69dc98e7-3320-4dc7-93d2-57f0e946dac0): created successfully Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61780140-1fee-4299-b501-8e4e2942e09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:12 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024 Jul 05 17:28:12 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Flow 'volume_create_manager' (3fb9e713-2211-404f-9cfa-e452f5f22040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7ee0923d-02f7-42ba-8ae8-2c2da51e6536 tempest-VolumesTransfersV357Test-1367259206 None] Created volume successfully. Jul 05 17:28:13 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" returned: 0 in 0.962s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-quobyte-41d5d9de-7e72-4216-ac78-f6dbf9d9b024" released by "delete_volume" :: held 2.187s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Created reservations ['61fcaff0-5b3a-4440-9078-0c9b61b7e462', 'afc689e2-0990-4ec4-8696-0f8b17084adf', '5548a77b-1e2e-484b-8af0-06cb8ad99f39', 'a475492c-5d30-426f-a2f9-9704467e0708'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:13 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:28:13 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:14 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f4b73f6a-b64d-4610-9587-4bcfdd474a61 tempest-VolumesTransfersV357Test-1972683847 None] Transfer volume completed successfully. Jul 05 17:28:14 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.707s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:14 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:28:14 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Deleted volume successfully. Jul 05 17:28:14 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-570a1cb6-ebd2-4ed9-9b65-25762d6ee85d tempest-VolumeSnapshotQuotasNegativeTestJSON-1653198721 None] Lock "cinder-41d5d9de-7e72-4216-ac78-f6dbf9d9b024-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Acquiring lock "cinder-69dc98e7-3320-4dc7-93d2-57f0e946dac0-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Lock "cinder-69dc98e7-3320-4dc7-93d2-57f0e946dac0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Acquiring lock "cinder-quobyte-69dc98e7-3320-4dc7-93d2-57f0e946dac0" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Lock "cinder-quobyte-69dc98e7-3320-4dc7-93d2-57f0e946dac0" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:15 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1783923-b59a-4159-96ca-6426864f1701]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:15 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 Jul 05 17:28:15 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:16 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0" returned: 0 in 0.929s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:16 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0 Jul 05 17:28:16 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:16 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-69dc98e7-3320-4dc7-93d2-57f0e946dac0" returned: 0 in 0.810s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Lock "cinder-quobyte-69dc98e7-3320-4dc7-93d2-57f0e946dac0" released by "delete_volume" :: held 1.799s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:17 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Created reservations ['eb21eb3c-55c1-4db2-866c-fdddf37eeed4', 'd7ec70fc-b826-4943-bc8c-b752e6d6b1b5', '0cd9b091-c30b-48fb-966c-7e0ead4275fa', '174e740a-fa88-4cb6-a737-973da6b2aa07'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:28:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:17 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:28:17 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:28:18 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Flow 'volume_create_manager' (3273d7cb-da4b-4d47-9bcb-9f898bda62f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a189779-acf5-4e59-b678-e974dc378cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.039s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:28:18 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Deleted volume successfully. Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a189779-acf5-4e59-b678-e974dc378cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-573204116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc83038a-4cfa-4a31-83de-8f1d79e41c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11bd75911334476f97e5e0cf39170603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:18Z,use_quota=True,user_id='da42cfc79af04fda81f1bdae4505acd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2046a4-963c-4588-af77-2db3e43cc56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2046a4-963c-4588-af77-2db3e43cc56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ba3f1c-79d6-454f-bab4-136074894e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ba3f1c-79d6-454f-bab4-136074894e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc83038a-4cfa-4a31-83de-8f1d79e41c0a', 'volume_name': 'volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8737cb54-1504-4bbe-b27b-3671645a1ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8737cb54-1504-4bbe-b27b-3671645a1ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4569dd7d-9ff3-4e7f-bb52-f9f46d4e418e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:18 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Volume dc83038a-4cfa-4a31-83de-8f1d79e41c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a', 'volume_size': 1} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-573204116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc83038a-4cfa-4a31-83de-8f1d79e41c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11bd75911334476f97e5e0cf39170603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:18Z,use_quota=True,user_id='da42cfc79af04fda81f1bdae4505acd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Creating volume dc83038a-4cfa-4a31-83de-8f1d79e41c0a {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:28:18 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:18 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a 1073741824 Jul 05 17:28:18 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4a93e7e6-55bc-4416-8909-b25a89dba6e9 tempest-VolumesTransfersV357Test-562086530 None] Lock "cinder-69dc98e7-3320-4dc7-93d2-57f0e946dac0-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:19 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a 1073741824" returned: 0 in 1.494s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:19 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a Jul 05 17:28:19 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:20 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a" returned: 0 in 0.978s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] <== create_volume: return (2537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:28:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.540s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4569dd7d-9ff3-4e7f-bb52-f9f46d4e418e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9857ebe7-fe3e-49a9-b24c-525beeb2c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:20 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Volume volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a (dc83038a-4cfa-4a31-83de-8f1d79e41c0a): created successfully Jul 05 17:28:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9857ebe7-fe3e-49a9-b24c-525beeb2c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Flow 'volume_create_manager' (3273d7cb-da4b-4d47-9bcb-9f898bda62f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-16e1cc4a-bde4-444b-ab89-5d11379d33ea tempest-VolumesTransfersV357Test-1367259206 None] Created volume successfully. Jul 05 17:28:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Acquiring lock "cinder-dc83038a-4cfa-4a31-83de-8f1d79e41c0a-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Lock "cinder-dc83038a-4cfa-4a31-83de-8f1d79e41c0a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Acquiring lock "cinder-quobyte-dc83038a-4cfa-4a31-83de-8f1d79e41c0a" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Lock "cinder-quobyte-dc83038a-4cfa-4a31-83de-8f1d79e41c0a" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:22 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8ace50-243d-4bea-bbfd-8774fe1d731f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:22 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a Jul 05 17:28:22 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:23 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a" returned: 0 in 1.171s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:23 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a Jul 05 17:28:23 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:24 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dc83038a-4cfa-4a31-83de-8f1d79e41c0a" returned: 0 in 1.017s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Lock "cinder-quobyte-dc83038a-4cfa-4a31-83de-8f1d79e41c0a" released by "delete_volume" :: held 2.240s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Created reservations ['0c2e37e5-3daf-4e2c-b737-42dff1934590', 'a4623fbf-35b1-417c-a54b-493b90627cc0', 'f33f3257-0918-466a-97dd-609fd2b3095e', '197454a5-4036-401a-b1e7-157d5ea84a9e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:24 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:28:24 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:25 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.815s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:25 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:28:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Deleted volume successfully. Jul 05 17:28:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-792f707c-853e-4fe0-9a25-b1a95911ce4f tempest-VolumesTransfersV357Test-562086530 None] Lock "cinder-dc83038a-4cfa-4a31-83de-8f1d79e41c0a-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=86,cinder:INSERT=40,cinder:UPDATE=117,cinder:DELETE=6 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=92,cinder:INSERT=24,cinder:UPDATE=99,cinder:DELETE=11 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Flow 'volume_create_manager' (e15e4448-d4b5-446e-84b9-125215430254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3244a88a-f770-4163-8af9-9e194a963348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3244a88a-f770-4163-8af9-9e194a963348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1136016486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7a174b-5d64-4a37-8fd4-7b836d4d2af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481c41cd73aa4908847fd27ef4c5b529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:35Z,use_quota=True,user_id='3c546bf2d5e54140a89208f2ade88770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d1fe26-dfb7-4d7d-a9de-e9aec300da04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d1fe26-dfb7-4d7d-a9de-e9aec300da04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed8795c-8d27-4fb2-8751-2642c91df519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed8795c-8d27-4fb2-8751-2642c91df519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7a174b-5d64-4a37-8fd4-7b836d4d2af1', 'volume_name': 'volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774c972b-37a3-4325-a987-7e393f1d2f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774c972b-37a3-4325-a987-7e393f1d2f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17ad6c5-35d3-418d-8b6b-9d86af2d1de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Volume 4d7a174b-5d64-4a37-8fd4-7b836d4d2af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1', 'volume_size': 1} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1136016486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7a174b-5d64-4a37-8fd4-7b836d4d2af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481c41cd73aa4908847fd27ef4c5b529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:35Z,use_quota=True,user_id='3c546bf2d5e54140a89208f2ade88770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Creating volume 4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:28:34 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:28:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:35 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 1073741824 Jul 05 17:28:35 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Flow 'volume_create_manager' (19339e41-c127-4444-9556-296fad5742cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72356432-5ac2-4018-a1ea-45d0d80bbe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72356432-5ac2-4018-a1ea-45d0d80bbe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-643072938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bed0775-7190-4695-b351-ba81dd85d815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9158a5749849f9ba934e073ca6a53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:36Z,use_quota=True,user_id='7f81ff1383e44dcc8ba8c35c4411541b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f21c9fb-8c02-4e6f-bad0-02d81fcd7c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f21c9fb-8c02-4e6f-bad0-02d81fcd7c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23fe39f-57e6-42ee-8694-a8b64f6af77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23fe39f-57e6-42ee-8694-a8b64f6af77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bed0775-7190-4695-b351-ba81dd85d815', 'volume_name': 'volume-8bed0775-7190-4695-b351-ba81dd85d815', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff4317b-63ef-4b6f-a972-4e83a16109e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff4317b-63ef-4b6f-a972-4e83a16109e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca9eae2-2cc6-489f-a2f7-d1865c639e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:35 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Volume 8bed0775-7190-4695-b351-ba81dd85d815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bed0775-7190-4695-b351-ba81dd85d815', 'volume_size': 1} Jul 05 17:28:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:36 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 1073741824" returned: 0 in 1.242s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:36 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 Jul 05 17:28:36 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:37 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" returned: 0 in 0.859s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-643072938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bed0775-7190-4695-b351-ba81dd85d815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9158a5749849f9ba934e073ca6a53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:36Z,use_quota=True,user_id='7f81ff1383e44dcc8ba8c35c4411541b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Creating volume 8bed0775-7190-4695-b351-ba81dd85d815 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:28:37 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17ad6c5-35d3-418d-8b6b-9d86af2d1de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:37 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 1073741824 Jul 05 17:28:37 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd03f5b5-200f-4c7b-ad59-7b6333426995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:37 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Volume volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 (4d7a174b-5d64-4a37-8fd4-7b836d4d2af1): created successfully Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd03f5b5-200f-4c7b-ad59-7b6333426995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Flow 'volume_create_manager' (e15e4448-d4b5-446e-84b9-125215430254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8bac6764-83b9-4e97-947d-4745db33e2c4 tempest-VolumesCloneTest-493337839 None] Created volume successfully. Jul 05 17:28:38 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 1073741824" returned: 0 in 1.565s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:38 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 Jul 05 17:28:38 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:38 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Flow 'volume_create_manager' (01f973e5-8f16-41ef-8cb5-9c5490b6f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8ef3da-d102-4b4e-8f4b-4aaebac9aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8ef3da-d102-4b4e-8f4b-4aaebac9aa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1480732924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c66763a-5df1-4f95-a558-3a58cba94e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481c41cd73aa4908847fd27ef4c5b529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4d7a174b-5d64-4a37-8fd4-7b836d4d2af1,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:39Z,use_quota=True,user_id='3c546bf2d5e54140a89208f2ade88770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e243df7d-a050-411b-81c2-aecd8aedd7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e243df7d-a050-411b-81c2-aecd8aedd7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c68cab4-607e-4b50-9fc1-91dc72133f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c68cab4-607e-4b50-9fc1-91dc72133f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7c66763a-5df1-4f95-a558-3a58cba94e27', 'volume_name': 'volume-7c66763a-5df1-4f95-a558-3a58cba94e27', 'volume_size': 2, 'source_volid': '4d7a174b-5d64-4a37-8fd4-7b836d4d2af1', 'source_volstatus': 'available'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a69754-7e8c-4e75-a183-004a9eeabe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a69754-7e8c-4e75-a183-004a9eeabe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec04aff-e7e2-43e7-9bc3-7ec2565a37e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:39 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Volume 7c66763a-5df1-4f95-a558-3a58cba94e27: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7c66763a-5df1-4f95-a558-3a58cba94e27', 'volume_size': 2, 'source_volid': '4d7a174b-5d64-4a37-8fd4-7b836d4d2af1', 'source_volstatus': 'available'} Jul 05 17:28:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:40 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815" returned: 0 in 1.194s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] <== create_volume: return (2862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.865s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.800s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:40 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Cloning volume 4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 to volume 7c66763a-5df1-4f95-a558-3a58cba94e27 Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca9eae2-2cc6-489f-a2f7-d1865c639e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bed0775-7190-4695-b351-ba81dd85d815', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f752327-d1e3-418b-a0cd-77b10eb49905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Volume volume-8bed0775-7190-4695-b351-ba81dd85d815 (8bed0775-7190-4695-b351-ba81dd85d815): created successfully Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f752327-d1e3-418b-a0cd-77b10eb49905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Flow 'volume_create_manager' (19339e41-c127-4444-9556-296fad5742cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-37503ad2-3a6c-46cd-b008-35071b63d87b tempest-TestMinimumBasicScenario-386277143 None] Created volume successfully. Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Creating offline snapshot 5a3e9007-de27-4dfa-8685-625aaf6212c7 of volume 4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe0ad5-5c26-452a-a61e-1d53116eb94d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:40 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 Jul 05 17:28:40 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:41 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" returned: 0 in 1.522s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:41 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 1G Jul 05 17:28:41 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:43 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 1G" returned: 0 in 1.415s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:43 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 Jul 05 17:28:43 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:44 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7" returned: 0 in 1.269s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:44 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 is being set with open permissions: ugo+rw Jul 05 17:28:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:44 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 Jul 05 17:28:44 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-7448f042-362a-4b22-8052-880cb6e9814a req-716fde39-1f7b-4aa0-b97f-3320f7231e2b tempest-TestMinimumBasicScenario-386277143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:45 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7" returned: 0 in 1.391s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:45 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.info Jul 05 17:28:45 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (ef5981a1-6c93-42a1-a25e-82d8f1bc8d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8b90b2-5dcc-41d5-a1f8-aed1c6ba61e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8b90b2-5dcc-41d5-a1f8-aed1c6ba61e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2117108471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8086855a-f8db-4f61-929c-00e57267d1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:46Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3089d4e0-76e1-4e58-9d06-3fa6999608c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3089d4e0-76e1-4e58-9d06-3fa6999608c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dff3676-3477-4f5c-b0f6-c9f53c51b324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dff3676-3477-4f5c-b0f6-c9f53c51b324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8086855a-f8db-4f61-929c-00e57267d1ca', 'volume_name': 'volume-8086855a-f8db-4f61-929c-00e57267d1ca', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c361ae-b834-433d-b3b4-7e05eb047004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c361ae-b834-433d-b3b4-7e05eb047004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01372ffb-d7d8-4314-a69a-c8d382292e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:46 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Volume 8086855a-f8db-4f61-929c-00e57267d1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8086855a-f8db-4f61-929c-00e57267d1ca', 'volume_size': 1} Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:46 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.info" returned: 0 in 0.998s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:46 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.info is being set with open permissions: ugo+rw Jul 05 17:28:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:46 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.info Jul 05 17:28:46 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:47 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.info" returned: 0 in 0.782s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Acquiring lock "cinder-quobyte-7c66763a-5df1-4f95-a558-3a58cba94e27" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Lock "cinder-quobyte-7c66763a-5df1-4f95-a558-3a58cba94e27" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] snapshot: 5a3e9007-de27-4dfa-8685-625aaf6212c7, volume: 7c66763a-5df1-4f95-a558-3a58cba94e27, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ce057b-fe85-4fa0-ae12-f41c880e23f4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:47 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 Jul 05 17:28:47 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:48 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7" returned: 0 in 0.816s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:28:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:28:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:28:48 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ca8c0-e714-4b53-af90-777738eeb0f2]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:48 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 Jul 05 17:28:48 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Flow 'volume_create_manager' (17d0f53f-5a03-4ad0-883b-0840f2d83b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e26c480-e35d-46f5-b91e-ff28b0b1fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e26c480-e35d-46f5-b91e-ff28b0b1fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1378262149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8ec551-e459-46b0-8920-f762f7895a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6070887b4d7444891481ed66293e7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:49Z,use_quota=True,user_id='b109d0bcd43541569a45695069a01649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b1eb27-405c-430b-acae-5fa612091fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b1eb27-405c-430b-acae-5fa612091fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdf8b8e-ddbb-4ea5-ad85-db27af2c7405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdf8b8e-ddbb-4ea5-ad85-db27af2c7405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb8ec551-e459-46b0-8920-f762f7895a76', 'volume_name': 'volume-eb8ec551-e459-46b0-8920-f762f7895a76', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361e0760-77e8-416c-a35b-5126d5e8d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361e0760-77e8-416c-a35b-5126d5e8d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8ca63c-5ffb-452e-86e4-770c1e0c1baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:28:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Volume eb8ec551-e459-46b0-8920-f762f7895a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb8ec551-e459-46b0-8920-f762f7895a76', 'volume_size': 1} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:49 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" returned: 0 in 0.858s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:28:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:49 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 Jul 05 17:28:49 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:28:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:28:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:28:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:28:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:28:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:28:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:50 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:28:50 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:53 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 2.300s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:53 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:28:53 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:28:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:28:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:28:56 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27" returned: 0 in 7.289s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:56 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99b1b41-e6f0-435f-98b9-f2f68fe58063]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:56 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 Jul 05 17:28:56 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:57 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" returned: 0 in 0.926s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:57 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:28:57 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Converted 1024.00 MB image at 140.45 MB/s Jul 05 17:28:57 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 is being set with open permissions: ugo+rw Jul 05 17:28:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:57 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 Jul 05 17:28:57 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:58 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27" returned: 0 in 0.621s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Lock "cinder-quobyte-7c66763a-5df1-4f95-a558-3a58cba94e27" released by "_copy_volume_from_snapshot" :: held 10.609s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:28:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Acquiring lock "cinder-quobyte-5a3e9007-de27-4dfa-8685-625aaf6212c7" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:28:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Lock "cinder-quobyte-5a3e9007-de27-4dfa-8685-625aaf6212c7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:28:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Deleting offline snapshot 5a3e9007-de27-4dfa-8685-625aaf6212c7 of volume 4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:28:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] snapshot_file for this snap is: volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:28:58 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a9df34-beea-4f28-9b09-d422be72a092]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:58 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 Jul 05 17:28:58 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:59 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:28:59 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7" returned: 0 in 0.747s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:28:59 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaac289-4f3e-44c4-9cff-39cf98d84be0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:28:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:59 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 Jul 05 17:28:59 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:28:59 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 05 17:28:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" returned: 0 in 0.747s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:28:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:28:59 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 Jul 05 17:28:59 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:00 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7" returned: 0 in 0.711s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:00 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7 Jul 05 17:29:00 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:01 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1.5a3e9007-de27-4dfa-8685-625aaf6212c7" returned: 0 in 0.629s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Lock "cinder-quobyte-5a3e9007-de27-4dfa-8685-625aaf6212c7" released by "_delete_snapshot" :: held 2.914s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.288s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-7448f042-362a-4b22-8052-880cb6e9814a req-716fde39-1f7b-4aa0-b97f-3320f7231e2b tempest-TestMinimumBasicScenario-386277143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.850s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec04aff-e7e2-43e7-9bc3-7ec2565a37e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c66763a-5df1-4f95-a558-3a58cba94e27', 'volume_size': 2, 'source_volid': '4d7a174b-5d64-4a37-8fd4-7b836d4d2af1', 'source_volstatus': 'available'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcb4fc7-94af-4eba-ad9c-fecdf0e5b7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69810df-8757-4129-947a-4e850cf0f847]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-7448f042-362a-4b22-8052-880cb6e9814a req-716fde39-1f7b-4aa0-b97f-3320f7231e2b tempest-TestMinimumBasicScenario-386277143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:01 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Volume volume-7c66763a-5df1-4f95-a558-3a58cba94e27 (7c66763a-5df1-4f95-a558-3a58cba94e27): created successfully Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcb4fc7-94af-4eba-ad9c-fecdf0e5b7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Flow 'volume_create_manager' (01f973e5-8f16-41ef-8cb5-9c5490b6f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:01 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-17b7463f-1c9c-4c0c-9718-e33a04a900e2 tempest-VolumesCloneTest-493337839 None] Created volume successfully. Jul 05 17:29:01 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 Jul 05 17:29:01 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:02 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-7448f042-362a-4b22-8052-880cb6e9814a req-716fde39-1f7b-4aa0-b97f-3320f7231e2b tempest-TestMinimumBasicScenario-386277143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815" returned: 0 in 0.737s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-7448f042-362a-4b22-8052-880cb6e9814a req-716fde39-1f7b-4aa0-b97f-3320f7231e2b tempest-TestMinimumBasicScenario-386277143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.845s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2117108471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8086855a-f8db-4f61-929c-00e57267d1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:46Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Creating volume 8086855a-f8db-4f61-929c-00e57267d1ca {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:02 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:02 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca 1073741824 Jul 05 17:29:02 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-7448f042-362a-4b22-8052-880cb6e9814a req-716fde39-1f7b-4aa0-b97f-3320f7231e2b tempest-TestMinimumBasicScenario-386277143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-8bed0775-7190-4695-b351-ba81dd85d815', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57179958-71ef-48bf-99cd-32fe2f09b34a', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Acquiring lock "cinder-7c66763a-5df1-4f95-a558-3a58cba94e27-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Lock "cinder-7c66763a-5df1-4f95-a558-3a58cba94e27-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:02 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-7448f042-362a-4b22-8052-880cb6e9814a req-716fde39-1f7b-4aa0-b97f-3320f7231e2b tempest-TestMinimumBasicScenario-386277143 None] attachment_update completed successfully. Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Acquiring lock "cinder-quobyte-7c66763a-5df1-4f95-a558-3a58cba94e27" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Lock "cinder-quobyte-7c66763a-5df1-4f95-a558-3a58cba94e27" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f59f40-f409-4a7f-9e73-28b5464e6b0c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:02 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 Jul 05 17:29:02 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:03 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca 1073741824" returned: 0 in 1.001s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:03 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca Jul 05 17:29:03 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:03 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27" returned: 0 in 0.993s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:03 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27 Jul 05 17:29:03 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:03 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.791s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1378262149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8ec551-e459-46b0-8920-f762f7895a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6070887b4d7444891481ed66293e7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:28:49Z,use_quota=True,user_id='b109d0bcd43541569a45695069a01649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Creating volume eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:03 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01372ffb-d7d8-4314-a69a-c8d382292e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8086855a-f8db-4f61-929c-00e57267d1ca', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:03 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 1073741824 Jul 05 17:29:03 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a469e9-b01b-45ec-8cc6-3784ac8965e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:03 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Volume volume-8086855a-f8db-4f61-929c-00e57267d1ca (8086855a-f8db-4f61-929c-00e57267d1ca): created successfully Jul 05 17:29:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a469e9-b01b-45ec-8cc6-3784ac8965e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (ef5981a1-6c93-42a1-a25e-82d8f1bc8d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-525ccb77-b08e-4bba-975b-973c477f4218 tempest-VolumesActionsTest-1482641577 None] Created volume successfully. Jul 05 17:29:04 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7c66763a-5df1-4f95-a558-3a58cba94e27" returned: 0 in 0.735s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Lock "cinder-quobyte-7c66763a-5df1-4f95-a558-3a58cba94e27" released by "delete_volume" :: held 1.784s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Created reservations ['43b3de42-88d6-4c74-92cd-c7d507afd3f2', '62a1e1cc-7331-4a47-b925-346b49ea9449', '5c235432-fd3c-44b6-9679-5fbb987da516', 'e981d109-7dd4-4640-8be0-0160cd7a515c'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:04 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:04 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5654ddee-02ec-49c0-9e6f-8cb398cde194 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca" by "attach_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5654ddee-02ec-49c0-9e6f-8cb398cde194 tempest-VolumesActionsTest-1482641577 None] Lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca" acquired by "attach_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5654ddee-02ec-49c0-9e6f-8cb398cde194 tempest-VolumesActionsTest-1482641577 None] Attaching volume 8086855a-f8db-4f61-929c-00e57267d1ca to instance 386f2ccd-74fb-47da-8874-c541f71f5444 at mountpoint /dev/vdb on host None. Jul 05 17:29:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5654ddee-02ec-49c0-9e6f-8cb398cde194 tempest-VolumesActionsTest-1482641577 None] Attach volume completed successfully. Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5654ddee-02ec-49c0-9e6f-8cb398cde194 tempest-VolumesActionsTest-1482641577 None] Lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca" released by "attach_volume" :: held 0.160s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Acquiring lock "cinder-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Lock "cinder-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Acquiring lock "cinder-quobyte-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Lock "cinder-quobyte-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" acquired by "delete_volume" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac38f947-3e08-4dde-95bc-e8318ffe6f64]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:04 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 Jul 05 17:29:04 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:04 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.821s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:04 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Deleted volume successfully. Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c86ac57e-cac6-4126-8f48-732ec9ee51e2 tempest-VolumesCloneTest-493337839 None] Lock "cinder-7c66763a-5df1-4f95-a558-3a58cba94e27-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:05 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 1073741824" returned: 0 in 1.232s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:05 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 Jul 05 17:29:05 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6c329f5b-be1f-41b2-8ecc-dcde45104e87 tempest-VolumesActionsTest-1047727524 None] Terminate volume connection completed successfully. Jul 05 17:29:05 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" returned: 0 in 0.847s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:05 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1 Jul 05 17:29:05 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:05 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76" returned: 0 in 0.718s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8ca63c-5ffb-452e-86e4-770c1e0c1baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8ec551-e459-46b0-8920-f762f7895a76', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced11512-152a-4415-827f-6adb464aa72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:05 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Volume volume-eb8ec551-e459-46b0-8920-f762f7895a76 (eb8ec551-e459-46b0-8920-f762f7895a76): created successfully Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced11512-152a-4415-827f-6adb464aa72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Flow 'volume_create_manager' (17d0f53f-5a03-4ad0-883b-0840f2d83b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0fc9da69-89a8-4cc8-9c83-2481e5ec2206 tempest-VolumesDeleteCascade-9028449 None] Created volume successfully. Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6c329f5b-be1f-41b2-8ecc-dcde45104e87 tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-detach_volume" by "detach_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6c329f5b-be1f-41b2-8ecc-dcde45104e87 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6c329f5b-be1f-41b2-8ecc-dcde45104e87 tempest-VolumesActionsTest-1047727524 None] Detaching volume 8086855a-f8db-4f61-929c-00e57267d1ca from instance 386f2ccd-74fb-47da-8874-c541f71f5444. Jul 05 17:29:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6c329f5b-be1f-41b2-8ecc-dcde45104e87 tempest-VolumesActionsTest-1047727524 None] Detach volume completed successfully. Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6c329f5b-be1f-41b2-8ecc-dcde45104e87 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:06 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" returned: 0 in 0.678s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Lock "cinder-quobyte-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1" released by "delete_volume" :: held 1.590s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Created reservations ['5344275e-9966-4e76-a09b-1abed10f77e6', '8aa418c7-c622-4769-8674-f97fae4f1563', '97bc6214-3f82-4f96-8adf-ddddad0e7f20', '241e716c-aa2c-45c2-b31b-3e5115d93af9'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:06 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:06 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-86a2d52d-13ba-4267-acee-8fc79c449ab7 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-detach_volume" by "detach_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-86a2d52d-13ba-4267-acee-8fc79c449ab7 tempest-VolumesActionsTest-1482641577 None] Lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-86a2d52d-13ba-4267-acee-8fc79c449ab7 tempest-VolumesActionsTest-1482641577 None] Volume detach called, but volume not attached. Jul 05 17:29:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-86a2d52d-13ba-4267-acee-8fc79c449ab7 tempest-VolumesActionsTest-1482641577 None] Lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Creating offline snapshot b7d05ced-c483-41f3-98a0-e3632cf4199c of volume eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:29:07 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.820s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Deleted volume successfully. Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae62f63-1ca3-466a-bba5-bb37e20fc578]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b83cc2eb-dbe2-47ce-80ff-57558731d07c tempest-VolumesCloneTest-493337839 None] Lock "cinder-4d7a174b-5d64-4a37-8fd4-7b836d4d2af1-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Acquiring lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Acquiring lock "cinder-quobyte-8086855a-f8db-4f61-929c-00e57267d1ca" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:07 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 Jul 05 17:29:07 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Lock "cinder-quobyte-8086855a-f8db-4f61-929c-00e57267d1ca" acquired by "delete_volume" :: waited 0.034s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cc9525-5b7e-42ea-9b28-1aa9d0455696]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:07 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca Jul 05 17:29:07 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:08 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76" returned: 0 in 1.151s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:08 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c 1G Jul 05 17:29:08 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:08 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca" returned: 0 in 1.090s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:08 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca Jul 05 17:29:08 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:09 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8086855a-f8db-4f61-929c-00e57267d1ca" returned: 0 in 0.851s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Lock "cinder-quobyte-8086855a-f8db-4f61-929c-00e57267d1ca" released by "delete_volume" :: held 2.002s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:09 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c 1G" returned: 0 in 1.084s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8ec551-e459-46b0-8920-f762f7895a76 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:09 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8ec551-e459-46b0-8920-f762f7895a76 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c Jul 05 17:29:09 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Created reservations ['5202c71d-c890-457d-86bf-b5260b89c3eb', '85334410-164e-4018-9dc1-ed28784fadbf', '6d54c1f8-bdee-4d0c-9de7-8c45493cbe80', '6e822e5b-8c9f-4c56-82e3-c914981e9b52'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:09 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:09 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:10 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:10 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.069s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:10 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8ec551-e459-46b0-8920-f762f7895a76 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c" returned: 0 in 1.282s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:10 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c is being set with open permissions: ugo+rw Jul 05 17:29:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Deleted volume successfully. Jul 05 17:29:10 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c Jul 05 17:29:10 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8519f637-bf96-4bdd-9dd3-9046d8a2624b tempest-VolumesActionsTest-1482641577 None] Lock "cinder-8086855a-f8db-4f61-929c-00e57267d1ca-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Flow 'volume_create_manager' (ffe81f47-384e-4f45-b622-895cbe77c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52dafc20-bc40-46aa-9636-5ad18b10e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52dafc20-bc40-46aa-9636-5ad18b10e802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-456774800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164d2137-29d6-4f26-b1f2-1cb5575b0d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21d4e9a713a4fc2b4b784f6efe485fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:12Z,use_quota=True,user_id='47e1a41c4c0547b0b548ff93959b430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9f6a17-ff91-4cdc-b760-ba892981b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9f6a17-ff91-4cdc-b760-ba892981b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fae7e1-d816-48a9-b4eb-46181f7403db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:29:11 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c" returned: 0 in 0.899s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:11 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.info Jul 05 17:29:11 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fae7e1-d816-48a9-b4eb-46181f7403db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '164d2137-29d6-4f26-b1f2-1cb5575b0d6a', 'volume_name': 'volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f70065-b0c6-46d7-96d9-b3e9d0721ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f70065-b0c6-46d7-96d9-b3e9d0721ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af64d5c6-2901-4131-b801-9a97edb48a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:12 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Volume 164d2137-29d6-4f26-b1f2-1cb5575b0d6a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Trying to clone 164d2137-29d6-4f26-b1f2-1cb5575b0d6a from image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:29:12 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Image download 20.69 MB at 20.69 MB/s Jul 05 17:29:12 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.info" returned: 0 in 1.018s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:12 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.info is being set with open permissions: ugo+rw Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:12 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.info Jul 05 17:29:12 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd5c9fb-68a2-4916-9ac2-7934a315ecbb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:12 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD Jul 05 17:29:12 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:13 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.info" returned: 0 in 0.922s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.481s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:13 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d69aea0f-53fe-4131-a083-50473ab97676 tempest-VolumesDeleteCascade-9028449 None] Create snapshot completed successfully Jul 05 17:29:13 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:13 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Temporary image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 is fetched for user 47e1a41c4c0547b0b548ff93959b430e. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:29:13 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d7b881-f293-485e-b818-e128a4550899]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:13 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD Jul 05 17:29:13 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:14 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-456774800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164d2137-29d6-4f26-b1f2-1cb5575b0d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21d4e9a713a4fc2b4b784f6efe485fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:12Z,use_quota=True,user_id='47e1a41c4c0547b0b548ff93959b430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Creating volume 164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:14 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:14 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a 1073741824 Jul 05 17:29:14 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:15 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a 1073741824" returned: 0 in 0.904s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:15 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:15 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:16 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 0 in 0.653s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.439s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Creating offline snapshot 2fa1d679-7d36-45dd-8832-4ae2fa41a1fd of volume eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Attempting download of ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}])) to volume 164d2137-29d6-4f26-b1f2-1cb5575b0d6a. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b06d49-aa0d-467e-ad10-84c2a31f4e43]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a27ef6-31b1-49da-a156-d2ca2f4244c7]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_5y9syysb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:16 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c Jul 05 17:29:16 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:16 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_5y9syysb Jul 05 17:29:16 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:17 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_5y9syysb" returned: 0 in 0.829s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:17 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_5y9syysb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c" returned: 0 in 0.905s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb8ec551-e459-46b0-8920-f762f7895a76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:17 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd 1G Jul 05 17:29:17 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:17 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_5y9syysb Jul 05 17:29:17 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (a084fb86-fbd1-49a7-b9d5-4bf055c60088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8169288-4a71-4a24-89c9-57f287cfa2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8169288-4a71-4a24-89c9-57f287cfa2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1296215012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90247e5c-5b2b-4a30-90d9-ab48274e7df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:18Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bde0844-8b72-4436-962b-4a5aa2f66e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bde0844-8b72-4436-962b-4a5aa2f66e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b39c41-0820-491b-b9f5-a93c07b80d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b39c41-0820-491b-b9f5-a93c07b80d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90247e5c-5b2b-4a30-90d9-ab48274e7df5', 'volume_name': 'volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea77b1c-334b-43b8-8525-432accb584de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea77b1c-334b-43b8-8525-432accb584de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb886166-852c-41e2-9398-69ae6dfe7809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:17 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Volume 90247e5c-5b2b-4a30-90d9-ab48274e7df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5', 'volume_size': 1} Jul 05 17:29:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:18 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_5y9syysb" returned: 1 in 0.823s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_5y9syysb' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f899d0c-fe2a-4bc7-95ee-22b3efc05845]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:18 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD Jul 05 17:29:18 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:18 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd 1G" returned: 0 in 0.957s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:18 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd Jul 05 17:29:18 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:18 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 was qcow2, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:29:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:18 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:18 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:19 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd" returned: 0 in 0.830s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:19 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd is being set with open permissions: ugo+rw Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:19 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd Jul 05 17:29:19 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:19 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd" returned: 0 in 0.768s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.587s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1296215012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90247e5c-5b2b-4a30-90d9-ab48274e7df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:18Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Creating volume 90247e5c-5b2b-4a30-90d9-ab48274e7df5 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:19 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:19 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 1073741824 Jul 05 17:29:19 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6df803d5-7702-46d9-92b7-0c2d2b2c82c7 tempest-VolumesDeleteCascade-9028449 None] Create snapshot completed successfully Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-eb8ec551-e459-46b0-8920-f762f7895a76-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-eb8ec551-e459-46b0-8920-f762f7895a76-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Performing cascade delete. {{(pid=86459) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-2fa1d679-7d36-45dd-8832-4ae2fa41a1fd-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-2fa1d679-7d36-45dd-8832-4ae2fa41a1fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-2fa1d679-7d36-45dd-8832-4ae2fa41a1fd" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-2fa1d679-7d36-45dd-8832-4ae2fa41a1fd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Deleting offline snapshot 2fa1d679-7d36-45dd-8832-4ae2fa41a1fd of volume eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] snapshot_file for this snap is: volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[51981c42-7d94-4c2b-81e4-fa4b77481ed9]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:20 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd Jul 05 17:29:20 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:20 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 1073741824" returned: 0 in 1.038s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:21 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 Jul 05 17:29:21 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:21 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 0 in 2.262s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4__br4t68wdevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:29:21 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Converted 112.00 MB image at 49.48 MB/s Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:21 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a 1G Jul 05 17:29:21 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:21 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd" returned: 0 in 0.963s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb8ec551-e459-46b0-8920-f762f7895a76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce6c29e-3708-49a9-acc7-105c71c45aef]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:21 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c Jul 05 17:29:21 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:21 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5" returned: 0 in 0.730s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb886166-852c-41e2-9398-69ae6dfe7809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d67e20-dadc-4536-b0a8-26190132aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:21 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Volume volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 (90247e5c-5b2b-4a30-90d9-ab48274e7df5): created successfully Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d67e20-dadc-4536-b0a8-26190132aee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (a084fb86-fbd1-49a7-b9d5-4bf055c60088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:21 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-657e8be1-ec66-4fbb-a85c-97b2a3281e34 tempest-VolumesActionsTest-1482641577 None] Created volume successfully. Jul 05 17:29:21 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a 1G" returned: 0 in 0.801s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:22 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2b96e0-7447-4e55-b204-d37b6d1e7121]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:22 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:22 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:22 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c" returned: 0 in 0.861s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb8ec551-e459-46b0-8920-f762f7895a76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:29:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:22 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd Jul 05 17:29:22 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:22 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 0 in 0.754s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:22 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:22 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-90247e5c-5b2b-4a30-90d9-ab48274e7df5-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-90247e5c-5b2b-4a30-90d9-ab48274e7df5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:23 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd" returned: 0 in 0.855s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:23 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd Jul 05 17:29:23 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-quobyte-90247e5c-5b2b-4a30-90d9-ab48274e7df5" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-quobyte-90247e5c-5b2b-4a30-90d9-ab48274e7df5" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6973bee-0579-4831-8828-622b23047b26]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:23 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 Jul 05 17:29:23 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:23 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 1 in 0.865s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Downloaded image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}])) to volume 164d2137-29d6-4f26-b1f2-1cb5575b0d6a successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Temporary image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 for user 47e1a41c4c0547b0b548ff93959b430e is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Marking volume 164d2137-29d6-4f26-b1f2-1cb5575b0d6a as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Copying metadata from image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 to 164d2137-29d6-4f26-b1f2-1cb5575b0d6a. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Creating volume glance metadata for volume 164d2137-29d6-4f26-b1f2-1cb5575b0d6a backed by image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af64d5c6-2901-4131-b801-9a97edb48a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4527b2d7-a372-44f2-bb99-5e3bc86ddb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:23 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Volume volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a (164d2137-29d6-4f26-b1f2-1cb5575b0d6a): created successfully Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4527b2d7-a372-44f2-bb99-5e3bc86ddb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Flow 'volume_create_manager' (ffe81f47-384e-4f45-b622-895cbe77c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:23 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a6321b95-bc82-44e9-9d7e-654d2cd0cd3b tempest-VolumesExtendTest-1129158519 None] Created volume successfully. Jul 05 17:29:23 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.2fa1d679-7d36-45dd-8832-4ae2fa41a1fd" returned: 0 in 0.723s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-2fa1d679-7d36-45dd-8832-4ae2fa41a1fd" released by "_delete_snapshot" :: held 3.531s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" released by "delete_snapshot" :: held 3.566s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Created reservations ['fb77ef21-235f-40b4-a781-c445cea85245', 'ecb0a09e-8612-4e68-a992-7a4513a9ed8c', '83d60a0d-3c1b-4ef5-a83e-a15cd302559f', 'c8a9561e-0b91-4926-ab1a-39fc63ff077b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:24 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Delete snapshot completed successfully. Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-2fa1d679-7d36-45dd-8832-4ae2fa41a1fd-delete_snapshot" released by "delete_snapshot" :: held 3.741s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-b7d05ced-c483-41f3-98a0-e3632cf4199c-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-b7d05ced-c483-41f3-98a0-e3632cf4199c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:24 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5" returned: 0 in 0.856s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:24 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5 Jul 05 17:29:24 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-b7d05ced-c483-41f3-98a0-e3632cf4199c" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-b7d05ced-c483-41f3-98a0-e3632cf4199c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Deleting offline snapshot b7d05ced-c483-41f3-98a0-e3632cf4199c of volume eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] snapshot_file for this snap is: volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb39dbb-00b4-4290-b66f-ea7d54719598]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:24 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c Jul 05 17:29:24 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[02edbb2a-bfc0-463e-8289-567514c03d40]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:24 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90247e5c-5b2b-4a30-90d9-ab48274e7df5" returned: 0 in 0.837s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-quobyte-90247e5c-5b2b-4a30-90d9-ab48274e7df5" released by "delete_volume" :: held 1.736s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:24 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:24 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Created reservations ['d869d712-44a2-4c67-b96f-74f13102f60a', '38d8ede9-f2a2-4f43-9619-95a7d9aa699d', 'e3120ca2-5fe4-4e37-b8fa-fb999be1022c', 'c4a525f4-cbdb-452e-806d-94d7432d20d5'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:25 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:25 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:25 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c" returned: 0 in 1.012s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb8ec551-e459-46b0-8920-f762f7895a76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb163a-712b-441f-9f0b-4a61ed6f25be]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:25 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 Jul 05 17:29:25 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:26 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.093s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:26 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Deleted volume successfully. Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-582accca-e682-44bf-b83d-f1d1cedeffd6 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-90247e5c-5b2b-4a30-90d9-ab48274e7df5-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:26 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 0 in 1.461s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:26 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:26 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (95ddf114-516f-4f6f-b71a-d794ec1a16f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f1303c-f71e-490d-9839-cafe9d8557d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f1303c-f71e-490d-9839-cafe9d8557d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2106812635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250d8ddb-76d6-4231-8174-8ea6f011b8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:26Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa07cc5a-e5f5-48d0-93cd-4066c7319868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa07cc5a-e5f5-48d0-93cd-4066c7319868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95cc688-a801-46d1-afb8-8c56b08d90f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95cc688-a801-46d1-afb8-8c56b08d90f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250d8ddb-76d6-4231-8174-8ea6f011b8d9', 'volume_name': 'volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3724f9a3-667c-4cee-8404-38283bf30f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3724f9a3-667c-4cee-8404-38283bf30f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f68a4bc-d7db-4bb2-a8b4-2d38657cca0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:26 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Volume 250d8ddb-76d6-4231-8174-8ea6f011b8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9', 'volume_size': 1} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:26 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76" returned: 0 in 1.362s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:26 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c Jul 05 17:29:26 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:27 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 1 in 0.915s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a 2G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a 2G" returned: 0 in 0.070s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.515s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2106812635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250d8ddb-76d6-4231-8174-8ea6f011b8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:26Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Creating volume 250d8ddb-76d6-4231-8174-8ea6f011b8d9 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:27 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:27 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 1073741824 Jul 05 17:29:27 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3aa560f4-e423-4b18-9e39-12d51c27f96d tempest-VolumesExtendTest-1129158519 None] Extend volume completed successfully. Jul 05 17:29:27 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c" returned: 0 in 0.921s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:27 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c Jul 05 17:29:27 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:28 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76.b7d05ced-c483-41f3-98a0-e3632cf4199c" returned: 0 in 0.703s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-b7d05ced-c483-41f3-98a0-e3632cf4199c" released by "_delete_snapshot" :: held 4.130s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" released by "delete_snapshot" :: held 4.153s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:28 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 1073741824" returned: 0 in 0.955s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:28 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 Jul 05 17:29:28 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Created reservations ['fe9f569a-0991-4400-a41f-a9d778408242', '1167e90f-008e-465c-bec8-3f921ec494df', 'cfb837e8-1167-4b0f-b6d8-a61f734d2b22', '4704749a-3794-4424-94c2-968fd5e10981'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:28 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Delete snapshot completed successfully. Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-b7d05ced-c483-41f3-98a0-e3632cf4199c-delete_snapshot" released by "delete_snapshot" :: held 4.381s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Snapshots deleted, issuing volume delete {{(pid=86459) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a3bd31-e895-4ed1-bc05-44704ca9e4fc]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "cinder-164d2137-29d6-4f26-b1f2-1cb5575b0d6a-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-164d2137-29d6-4f26-b1f2-1cb5575b0d6a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "cinder-quobyte-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-quobyte-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:28 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 Jul 05 17:29:28 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d097dfb6-dee6-4280-bf52-a54f78ec1971]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:28 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:28 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:29 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9" returned: 0 in 0.841s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f68a4bc-d7db-4bb2-a8b4-2d38657cca0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8844a6-3750-4e54-99b9-b41481e8b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:29 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Volume volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 (250d8ddb-76d6-4231-8174-8ea6f011b8d9): created successfully Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8844a6-3750-4e54-99b9-b41481e8b301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (95ddf114-516f-4f6f-b71a-d794ec1a16f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3e019596-f984-4d63-a7ee-7837c9acbd1d tempest-VolumesActionsTest-1482641577 None] Created volume successfully. Jul 05 17:29:29 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76" returned: 0 in 0.965s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:29 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76 Jul 05 17:29:29 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-250d8ddb-76d6-4231-8174-8ea6f011b8d9-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:29 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 0 in 0.856s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-250d8ddb-76d6-4231-8174-8ea6f011b8d9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-quobyte-250d8ddb-76d6-4231-8174-8ea6f011b8d9" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-quobyte-250d8ddb-76d6-4231-8174-8ea6f011b8d9" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b22645-89ec-4908-b37c-a237f54a889c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:29 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:29 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:29 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 Jul 05 17:29:29 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:30 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eb8ec551-e459-46b0-8920-f762f7895a76" returned: 0 in 0.859s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-eb8ec551-e459-46b0-8920-f762f7895a76" released by "delete_volume" :: held 1.909s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Created reservations ['1526d3ab-5f4f-485f-ae14-6d521be6c86f', '15e2ce5b-0310-49da-994b-b3e8fcac51b8', 'eae8a5c7-174c-43c2-99aa-b94d16f2fcc3', '2d6b421a-2d7b-4a7b-819e-a0b0cb98e717'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:30 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 1 in 0.878s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:30 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a Jul 05 17:29:30 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:30 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:30 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:30 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9" returned: 0 in 1.057s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:30 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9 Jul 05 17:29:30 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:31 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" returned: 0 in 0.853s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-quobyte-164d2137-29d6-4f26-b1f2-1cb5575b0d6a" released by "delete_volume" :: held 2.671s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:31 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.861s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Deleted volume successfully. Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Created reservations ['50a07deb-0255-47eb-9b9c-1ce6c0d28dd6', 'fee4b592-d8a3-47e6-b7fc-11c17f6741ce', '452e837f-76e5-4527-a33d-77015bba6e2a', 'e56fdaa1-c20b-4c2c-81c7-1ba07cc5cd21'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8a6af0bc-312d-4ebf-b253-87e4f70fc1ef tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-eb8ec551-e459-46b0-8920-f762f7895a76-delete_volume" released by "delete_volume" :: held 11.256s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:31 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:31 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:31 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-250d8ddb-76d6-4231-8174-8ea6f011b8d9" returned: 0 in 0.949s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-quobyte-250d8ddb-76d6-4231-8174-8ea6f011b8d9" released by "delete_volume" :: held 2.063s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:31 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Created reservations ['3d5ed1c0-f9b5-46f4-bced-d179526dec5f', '4770e388-9134-4305-8594-1063463935d1', '8982b29a-bbf2-42bc-8415-d22e0cd16be3', '8eca9b0d-f5cb-4aff-a908-41f975db1081'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:32 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:32 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Flow 'volume_create_manager' (71325fdc-1cbc-44d3-83dc-8bb494e8a13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212a93b1-86ba-4ab5-8a1a-de920d5e5504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212a93b1-86ba-4ab5-8a1a-de920d5e5504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2079493869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193e42ed-875f-497e-b00a-28b21266b18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6070887b4d7444891481ed66293e7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:32Z,use_quota=True,user_id='b109d0bcd43541569a45695069a01649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e322bf5d-f63d-4fdd-a90d-563b96d7052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e322bf5d-f63d-4fdd-a90d-563b96d7052d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a103943b-54c2-4ad3-a693-75ef78d77631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a103943b-54c2-4ad3-a693-75ef78d77631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193e42ed-875f-497e-b00a-28b21266b18b', 'volume_name': 'volume-193e42ed-875f-497e-b00a-28b21266b18b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1373c993-3b4d-4494-96c1-aa3f599b99e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1373c993-3b4d-4494-96c1-aa3f599b99e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259f9a65-8d0d-43ac-9f42-2d5b5790cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:32 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Volume 193e42ed-875f-497e-b00a-28b21266b18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193e42ed-875f-497e-b00a-28b21266b18b', 'volume_size': 1} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2079493869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193e42ed-875f-497e-b00a-28b21266b18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6070887b4d7444891481ed66293e7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:32Z,use_quota=True,user_id='b109d0bcd43541569a45695069a01649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Creating volume 193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:32 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:32 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b 1073741824 Jul 05 17:29:32 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:32 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.223s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Deleted volume successfully. Jul 05 17:29:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ff97ebb1-9df6-44b2-96ee-eca61fa11af4 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-164d2137-29d6-4f26-b1f2-1cb5575b0d6a-delete_volume" released by "delete_volume" :: held 4.245s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:33 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.005s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:33 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Deleted volume successfully. Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-85aee669-f046-4e08-88f9-32cb65358db1 tempest-VolumesActionsTest-1047727524 None] Lock "cinder-250d8ddb-76d6-4231-8174-8ea6f011b8d9-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Flow 'volume_create_manager' (a1da8c87-a2cd-4ad5-94f2-9077ca9cf578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8ae065-177a-4efb-93c4-08d0790dd759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8ae065-177a-4efb-93c4-08d0790dd759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1841053226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f309ef34-a3a2-4d16-8dca-3d318910b715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21d4e9a713a4fc2b4b784f6efe485fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:33Z,use_quota=True,user_id='47e1a41c4c0547b0b548ff93959b430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79357716-1957-4d5a-aebc-3b9f1fe0369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79357716-1957-4d5a-aebc-3b9f1fe0369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf775e39-4e81-47d1-a8cc-4eae97a251dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf775e39-4e81-47d1-a8cc-4eae97a251dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f309ef34-a3a2-4d16-8dca-3d318910b715', 'volume_name': 'volume-f309ef34-a3a2-4d16-8dca-3d318910b715', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16a2a92-e0ae-4e4c-b006-242f248fd31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16a2a92-e0ae-4e4c-b006-242f248fd31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc26d23-a585-4937-8306-faf491f5f344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Volume f309ef34-a3a2-4d16-8dca-3d318910b715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f309ef34-a3a2-4d16-8dca-3d318910b715', 'volume_size': 1} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:33 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b 1073741824" returned: 0 in 1.153s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:33 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b Jul 05 17:29:33 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (33dd9804-a29e-458d-ac8c-cf3ede6c58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da0d680-c5ba-4253-9a60-268af8fb5d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da0d680-c5ba-4253-9a60-268af8fb5d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1682622381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:34Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ed1891-2704-4bc3-8fdd-1d35138eea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ed1891-2704-4bc3-8fdd-1d35138eea68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e663c90b-a7f8-4244-9f5d-75adf9e10531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e663c90b-a7f8-4244-9f5d-75adf9e10531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b', 'volume_name': 'volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8343c2c4-6b3c-4bc1-a316-d193c8958267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8343c2c4-6b3c-4bc1-a316-d193c8958267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bea888-affa-4f22-8e4e-df79ab2a734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:33 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Volume 0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b', 'volume_size': 1} Jul 05 17:29:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:34 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b" returned: 0 in 0.669s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.089s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1841053226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f309ef34-a3a2-4d16-8dca-3d318910b715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21d4e9a713a4fc2b4b784f6efe485fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:33Z,use_quota=True,user_id='47e1a41c4c0547b0b548ff93959b430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Creating volume f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:34 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259f9a65-8d0d-43ac-9f42-2d5b5790cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193e42ed-875f-497e-b00a-28b21266b18b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:34 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 1073741824 Jul 05 17:29:34 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683c0ae4-52e8-4571-9200-c53657b90cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Volume volume-193e42ed-875f-497e-b00a-28b21266b18b (193e42ed-875f-497e-b00a-28b21266b18b): created successfully Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683c0ae4-52e8-4571-9200-c53657b90cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Flow 'volume_create_manager' (71325fdc-1cbc-44d3-83dc-8bb494e8a13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-465f57cf-e323-43a2-b80b-f90ea684327c tempest-VolumesDeleteCascade-9028449 None] Created volume successfully. Jul 05 17:29:35 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 1073741824" returned: 0 in 0.839s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=115,cinder:SELECT=94,cinder:INSERT=28,cinder:DELETE=9 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:35 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 Jul 05 17:29:35 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:35 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715" returned: 0 in 0.714s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1682622381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:34Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Creating volume 0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:35 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:36 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b 1073741824 Jul 05 17:29:36 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc26d23-a585-4937-8306-faf491f5f344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f309ef34-a3a2-4d16-8dca-3d318910b715', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a271e5f2-49cb-47af-a4c5-b4ee233437d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:36 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Volume volume-f309ef34-a3a2-4d16-8dca-3d318910b715 (f309ef34-a3a2-4d16-8dca-3d318910b715): created successfully Jul 05 17:29:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a271e5f2-49cb-47af-a4c5-b4ee233437d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Flow 'volume_create_manager' (a1da8c87-a2cd-4ad5-94f2-9077ca9cf578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-faf2822d-6c2b-4bdc-ac7d-4347d4ee88ad tempest-VolumesExtendTest-1129158519 None] Created volume successfully. Jul 05 17:29:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:36 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b 1073741824" returned: 0 in 0.871s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:36 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b Jul 05 17:29:36 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:37 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b" returned: 0 in 0.665s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.847s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Creating offline snapshot d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 of volume 193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bea888-affa-4f22-8e4e-df79ab2a734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b72cf8a-3bb6-4acf-bd2b-3583a6eb7425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[183bbeb4-2639-4ddd-805a-eb807c2eae16]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:37 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Volume volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b (0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b): created successfully Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b72cf8a-3bb6-4acf-bd2b-3583a6eb7425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (33dd9804-a29e-458d-ac8c-cf3ede6c58c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e67542a5-f884-457c-ad64-8d4d16036ba8 tempest-VolumesActionsTest-1482641577 None] Created volume successfully. Jul 05 17:29:37 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b Jul 05 17:29:37 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Lock "cinder-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-quobyte-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Lock "cinder-quobyte-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[89050d26-5094-45db-8902-43b970f9a538]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:38 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b Jul 05 17:29:38 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:38 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b" returned: 0 in 0.754s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:38 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 1G Jul 05 17:29:38 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:38 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b" returned: 0 in 0.777s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:38 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b Jul 05 17:29:38 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:39 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 1G" returned: 0 in 0.786s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193e42ed-875f-497e-b00a-28b21266b18b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:39 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193e42ed-875f-497e-b00a-28b21266b18b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 Jul 05 17:29:39 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:39 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b" returned: 0 in 0.678s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Lock "cinder-quobyte-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b" released by "delete_volume" :: held 1.501s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Created reservations ['257420da-3716-4c13-a89a-af9d18cb34b3', 'ab9f5dd4-9516-462d-918b-a64079e286d9', '13eff43a-5f22-43d1-957a-256343451ecd', '267dfdab-f215-4dca-8ff4-bd765d2b8c32'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:39 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:39 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:39 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193e42ed-875f-497e-b00a-28b21266b18b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" returned: 0 in 0.682s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:39 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 is being set with open permissions: ugo+rw Jul 05 17:29:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:39 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 Jul 05 17:29:39 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:40 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.680s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Deleted volume successfully. Jul 05 17:29:40 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" returned: 0 in 0.663s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ed4068a-81e4-413e-af7c-36c0625c611c tempest-VolumesActionsTest-1047727524 None] Lock "cinder-0816d1b0-eeb6-4fdb-94e6-2c8ea744dc2b-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:40 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.info Jul 05 17:29:40 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (30815476-c66a-46b9-988e-04a577274e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c46793-1e3d-4f42-a0c4-f9ac327d7208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c46793-1e3d-4f42-a0c4-f9ac327d7208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2098411937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a099f7-6c1d-4489-8c04-462e34a1af7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:41Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14543098-7da0-4576-b356-af496d323a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14543098-7da0-4576-b356-af496d323a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8317800b-b2e8-4236-88b8-1723d26c5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8317800b-b2e8-4236-88b8-1723d26c5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a099f7-6c1d-4489-8c04-462e34a1af7d', 'volume_name': 'volume-15a099f7-6c1d-4489-8c04-462e34a1af7d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458ec83c-1516-452c-b745-2ae288e480bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458ec83c-1516-452c-b745-2ae288e480bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c93145d-067e-4445-bdc3-51e3f200727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Volume 15a099f7-6c1d-4489-8c04-462e34a1af7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a099f7-6c1d-4489-8c04-462e34a1af7d', 'volume_size': 1} Jul 05 17:29:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:41 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.info" returned: 0 in 0.660s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:41 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.info is being set with open permissions: ugo+rw Jul 05 17:29:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:41 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.info Jul 05 17:29:41 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:41 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.info" returned: 0 in 0.630s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.282s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.420s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Creating offline snapshot 6ca15ab6-2b40-49de-9c57-03a3ded81f78 of volume f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:29:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-bd5c90cb-6a60-45dd-bbf2-ff212c3b3cd8 tempest-VolumesDeleteCascade-9028449 None] Create snapshot completed successfully Jul 05 17:29:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f341ebe4-3f13-49a5-8083-71aaa4c69818]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:42 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 Jul 05 17:29:42 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Flow 'volume_create_manager' (5af6fb2c-1b16-4170-bd0f-5e3fa5e50028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6818515-d130-4260-9afc-a807b9c6fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6818515-d130-4260-9afc-a807b9c6fb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1715857959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a70138-a547-4922-a865-8caf44f0bd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6070887b4d7444891481ed66293e7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2b25476-0ca5-40ad-bcd5-fc991aaacaf5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:42Z,use_quota=True,user_id='b109d0bcd43541569a45695069a01649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c0a2b7-7a89-4b9e-ac59-5079b6a4f57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c0a2b7-7a89-4b9e-ac59-5079b6a4f57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683cc0b4-7001-46d0-bacf-c3e4dceeec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683cc0b4-7001-46d0-bacf-c3e4dceeec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '81a70138-a547-4922-a865-8caf44f0bd29', 'volume_name': 'volume-81a70138-a547-4922-a865-8caf44f0bd29', 'volume_size': 1, 'snapshot_id': 'd2b25476-0ca5-40ad-bcd5-fc991aaacaf5'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade576c7-6f5a-4167-bf2a-ddba6065956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade576c7-6f5a-4167-bf2a-ddba6065956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ad0e6a-0fea-4707-b1ab-bb98a235369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:42 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Volume 81a70138-a547-4922-a865-8caf44f0bd29: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-81a70138-a547-4922-a865-8caf44f0bd29', 'volume_size': 1, 'snapshot_id': 'd2b25476-0ca5-40ad-bcd5-fc991aaacaf5'} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:42 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715" returned: 0 in 0.807s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:42 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 1G Jul 05 17:29:42 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:43 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 1G" returned: 0 in 0.849s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f309ef34-a3a2-4d16-8dca-3d318910b715 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:43 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f309ef34-a3a2-4d16-8dca-3d318910b715 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 Jul 05 17:29:43 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:44 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f309ef34-a3a2-4d16-8dca-3d318910b715 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:44 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 is being set with open permissions: ugo+rw Jul 05 17:29:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:44 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 Jul 05 17:29:44 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:44 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78" returned: 0 in 0.670s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:45 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.info Jul 05 17:29:45 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:45 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.info" returned: 0 in 0.655s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:45 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.info is being set with open permissions: ugo+rw Jul 05 17:29:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:45 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.info Jul 05 17:29:45 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:46 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.info" returned: 0 in 0.638s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.461s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.368s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2098411937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a099f7-6c1d-4489-8c04-462e34a1af7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:41Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Creating volume 15a099f7-6c1d-4489-8c04-462e34a1af7d {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:46 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:46 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d 1073741824 Jul 05 17:29:46 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-83da2b3a-d14e-4522-a7bc-7b16039520d5 tempest-VolumesExtendTest-1129158519 None] Create snapshot completed successfully Jul 05 17:29:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f710edbb-6a4f-4a1c-b347-309fa5524132 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:47 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d 1073741824" returned: 0 in 0.931s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:47 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d Jul 05 17:29:47 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:47 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d" returned: 0 in 0.721s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.417s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5-81a70138-a547-4922-a865-8caf44f0bd29" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c93145d-067e-4445-bdc3-51e3f200727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a099f7-6c1d-4489-8c04-462e34a1af7d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd78f373-405c-4362-9aca-a57af32f2fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5-81a70138-a547-4922-a865-8caf44f0bd29" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Creating volume 81a70138-a547-4922-a865-8caf44f0bd29 from snapshot d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-81a70138-a547-4922-a865-8caf44f0bd29" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:48 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Volume volume-15a099f7-6c1d-4489-8c04-462e34a1af7d (15a099f7-6c1d-4489-8c04-462e34a1af7d): created successfully Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd78f373-405c-4362-9aca-a57af32f2fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (30815476-c66a-46b9-988e-04a577274e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-81a70138-a547-4922-a865-8caf44f0bd29" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] snapshot: d2b25476-0ca5-40ad-bcd5-fc991aaacaf5, volume: 81a70138-a547-4922-a865-8caf44f0bd29, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:29:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a3b76958-74b2-4e25-bb86-488bd95c1661 tempest-VolumesActionsTest-1482641577 None] Created volume successfully. Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59fd17c-8c78-4f57-9e8c-8054533d61d4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:48 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 Jul 05 17:29:48 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-15a099f7-6c1d-4489-8c04-462e34a1af7d-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Lock "cinder-15a099f7-6c1d-4489-8c04-462e34a1af7d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Acquiring lock "cinder-quobyte-15a099f7-6c1d-4489-8c04-462e34a1af7d" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Lock "cinder-quobyte-15a099f7-6c1d-4489-8c04-462e34a1af7d" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa39e36-99da-4703-b95f-a4e40f09004a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:48 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d Jul 05 17:29:48 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:49 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" returned: 0 in 0.936s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-193e42ed-875f-497e-b00a-28b21266b18b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:29:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:29:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:29:49 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1828b8b-defc-4e2a-abe0-c456da34b208]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:49 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b Jul 05 17:29:49 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:49 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d" returned: 0 in 0.992s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:49 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d Jul 05 17:29:49 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:50 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b" returned: 0 in 1.063s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:50 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 Jul 05 17:29:50 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:50 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-5940dff3-6005-4d5d-a96c-346c30e0d52f req-9cad08d8-4bd8-43d8-af9c-040c2e9d1702 tempest-TestMinimumBasicScenario-386277143 None] Terminate volume connection completed successfully. Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-5940dff3-6005-4d5d-a96c-346c30e0d52f req-9cad08d8-4bd8-43d8-af9c-040c2e9d1702 tempest-TestMinimumBasicScenario-386277143 None] Deleting attachment 57179958-71ef-48bf-99cd-32fe2f09b34a. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:29:50 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-15a099f7-6c1d-4489-8c04-462e34a1af7d" returned: 0 in 0.882s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Lock "cinder-quobyte-15a099f7-6c1d-4489-8c04-462e34a1af7d" released by "delete_volume" :: held 1.915s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Created reservations ['df99202e-7406-4eec-9006-d8b8e112580e', 'b30f13ef-430b-4d5f-9394-eb8c085c38fd', '13948359-2a97-431e-add8-a848e3aeb780', '0f3d57ab-dd3c-4f2c-901c-4a50aac8c5a4'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:50 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:50 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:50 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:50 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:51 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.236s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Deleted volume successfully. Jul 05 17:29:51 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:29:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (0a17f8d1-7253-459e-b92b-99c90637dbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00237b0b-73fe-44bf-acb9-4ee62e0f3309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00237b0b-73fe-44bf-acb9-4ee62e0f3309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-65800903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91963cc4-13b3-483f-95a8-8169842788c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:52Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1534c98-2268-4464-b892-c6798112b441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1534c98-2268-4464-b892-c6798112b441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4ef989-7f0b-498f-a0c2-3ffc8c2543da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4ef989-7f0b-498f-a0c2-3ffc8c2543da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91963cc4-13b3-483f-95a8-8169842788c4', 'volume_name': 'volume-91963cc4-13b3-483f-95a8-8169842788c4', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5a35a3-df77-4714-a853-2c878c82d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5a35a3-df77-4714-a853-2c878c82d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d5c140-2e81-41a7-a313-299b840beb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:52 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Volume 91963cc4-13b3-483f-95a8-8169842788c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91963cc4-13b3-483f-95a8-8169842788c4', 'volume_size': 1} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-548b9ec3-e41b-4aa8-ac3b-2b34d187a7da tempest-VolumesActionsTest-1047727524 None] Lock "cinder-15a099f7-6c1d-4489-8c04-462e34a1af7d-delete_volume" released by "delete_volume" :: held 3.614s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:52 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.615s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:29:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:29:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Acquiring lock "cinder-8bed0775-7190-4695-b351-ba81dd85d815-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Lock "cinder-8bed0775-7190-4695-b351-ba81dd85d815-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Acquiring lock "cinder-quobyte-8bed0775-7190-4695-b351-ba81dd85d815" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Lock "cinder-quobyte-8bed0775-7190-4695-b351-ba81dd85d815" acquired by "delete_volume" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:53 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4683ff7-5aa3-4130-ba98-6eb2db665a6c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:53 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 Jul 05 17:29:53 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:55 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815" returned: 0 in 2.013s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:55 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815 Jul 05 17:29:55 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:56 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29" returned: 0 in 6.418s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f548a5-07d1-4a82-a290-b313acd3346a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:56 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bed0775-7190-4695-b351-ba81dd85d815" returned: 0 in 1.378s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Lock "cinder-quobyte-8bed0775-7190-4695-b351-ba81dd85d815" released by "delete_volume" :: held 3.475s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Created reservations ['fa3ffe60-451c-4794-8ad7-493532719389', 'eb923f1e-bd63-4b5f-8422-5ae8928f4a84', 'dc51a3c9-859b-48b5-8060-0a9a6d5bbf28', '7f492167-8ef6-4546-b498-8e1db27f8155'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:29:56 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b Jul 05 17:29:56 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:56 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:29:56 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:57 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.649s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:57 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:29:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Deleted volume successfully. Jul 05 17:29:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8fbd8080-d2f6-44ca-b7a7-999ffeebf1ad tempest-TestMinimumBasicScenario-386277143 None] Lock "cinder-8bed0775-7190-4695-b351-ba81dd85d815-delete_volume" released by "delete_volume" :: held 4.444s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:57 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b" returned: 0 in 0.948s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:57 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:29:57 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Converted 1024.00 MB image at 159.51 MB/s Jul 05 17:29:57 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 is being set with open permissions: ugo+rw Jul 05 17:29:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:57 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 Jul 05 17:29:57 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:58 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29" returned: 0 in 0.680s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-81a70138-a547-4922-a865-8caf44f0bd29" released by "_copy_volume_from_snapshot" :: held 10.180s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5-81a70138-a547-4922-a865-8caf44f0bd29" released by "_create_volume_from_snapshot" :: held 10.234s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.291s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f710edbb-6a4f-4a1c-b347-309fa5524132 tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 11.360s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8942376-defa-4ace-a93b-7934e4ac4a55]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f710edbb-6a4f-4a1c-b347-309fa5524132 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ad0e6a-0fea-4707-b1ab-bb98a235369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a70138-a547-4922-a865-8caf44f0bd29', 'volume_size': 1, 'snapshot_id': 'd2b25476-0ca5-40ad-bcd5-fc991aaacaf5'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fac6e7-ca2e-49ea-8e18-030d2a92b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:29:58 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Volume volume-81a70138-a547-4922-a865-8caf44f0bd29 (81a70138-a547-4922-a865-8caf44f0bd29): created successfully Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fac6e7-ca2e-49ea-8e18-030d2a92b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:29:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Flow 'volume_create_manager' (5af6fb2c-1b16-4170-bd0f-5e3fa5e50028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:29:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6a67353c-87bd-42ab-b026-c53d3a3486ea tempest-VolumesDeleteCascade-9028449 None] Created volume successfully. Jul 05 17:29:58 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 Jul 05 17:29:58 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:59 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f710edbb-6a4f-4a1c-b347-309fa5524132 tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715" returned: 0 in 0.762s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f710edbb-6a4f-4a1c-b347-309fa5524132 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 2G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f710edbb-6a4f-4a1c-b347-309fa5524132 tempest-VolumesExtendTest-1129158519 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 2G" returned: 0 in 0.183s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f710edbb-6a4f-4a1c-b347-309fa5524132 tempest-VolumesExtendTest-1129158519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.982s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.175s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-65800903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91963cc4-13b3-483f-95a8-8169842788c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f805f3ef5f064d72b8e22964a1892853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:29:52Z,use_quota=True,user_id='fcbb7b8b54e6477cb78d9fdce21a7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Creating volume 91963cc4-13b3-483f-95a8-8169842788c4 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:29:59 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=132,cinder:SELECT=128,cinder:INSERT=42,cinder:DELETE=12 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-193e42ed-875f-497e-b00a-28b21266b18b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:59 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 1073741824 Jul 05 17:29:59 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-193e42ed-875f-497e-b00a-28b21266b18b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:59 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f710edbb-6a4f-4a1c-b347-309fa5524132 tempest-VolumesExtendTest-1129158519 None] Extend volume completed successfully. Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Performing cascade delete. {{(pid=86459) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-193e42ed-875f-497e-b00a-28b21266b18b" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-193e42ed-875f-497e-b00a-28b21266b18b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Deleting offline snapshot d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 of volume 193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] snapshot_file for this snap is: volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c8d8e-592a-44f6-9290-02c64f2ac28c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:29:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:29:59 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 Jul 05 17:29:59 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:00 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 1073741824" returned: 0 in 1.100s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:00 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 Jul 05 17:30:00 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:00 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" returned: 0 in 1.082s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-193e42ed-875f-497e-b00a-28b21266b18b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "cinder-6ca15ab6-2b40-49de-9c57-03a3ded81f78-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acc8798-9862-4e3d-bcc7-34c65adef832]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-6ca15ab6-2b40-49de-9c57-03a3ded81f78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "cinder-quobyte-f309ef34-a3a2-4d16-8dca-3d318910b715" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-quobyte-f309ef34-a3a2-4d16-8dca-3d318910b715" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "cinder-quobyte-6ca15ab6-2b40-49de-9c57-03a3ded81f78" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-quobyte-6ca15ab6-2b40-49de-9c57-03a3ded81f78" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Deleting offline snapshot 6ca15ab6-2b40-49de-9c57-03a3ded81f78 of volume f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] snapshot_file for this snap is: volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5b60e8-0397-4bf7-8b4a-6c4a452acb6a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:00 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b Jul 05 17:30:00 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:00 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 Jul 05 17:30:00 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:01 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4" returned: 0 in 0.844s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d5c140-2e81-41a7-a313-299b840beb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91963cc4-13b3-483f-95a8-8169842788c4', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29495fba-3b82-4d25-9032-7ebc9e491670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:01 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Volume volume-91963cc4-13b3-483f-95a8-8169842788c4 (91963cc4-13b3-483f-95a8-8169842788c4): created successfully Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29495fba-3b82-4d25-9032-7ebc9e491670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Flow 'volume_create_manager' (0a17f8d1-7253-459e-b92b-99c90637dbd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:01 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-85a7009e-32e4-444c-a89b-c211fd563150 tempest-VolumesActionsTest-1482641577 None] Created volume successfully. Jul 05 17:30:01 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b" returned: 0 in 0.934s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:01 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 Jul 05 17:30:01 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:01 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78" returned: 0 in 0.894s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f309ef34-a3a2-4d16-8dca-3d318910b715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f211bf-f8fe-483c-b3b1-1f9fdbb8c6b5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:01 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 Jul 05 17:30:01 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:02 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" returned: 0 in 0.884s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:02 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5 Jul 05 17:30:02 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Acquiring lock "cinder-91963cc4-13b3-483f-95a8-8169842788c4-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Lock "cinder-91963cc4-13b3-483f-95a8-8169842788c4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:02 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715" returned: 0 in 0.885s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:02 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 Jul 05 17:30:02 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Acquiring lock "cinder-quobyte-91963cc4-13b3-483f-95a8-8169842788c4" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Lock "cinder-quobyte-91963cc4-13b3-483f-95a8-8169842788c4" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed7ca12-a92d-48b7-96c8-cab40e72efaf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:02 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 Jul 05 17:30:02 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:03 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b.d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" returned: 0 in 0.793s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5" released by "_delete_snapshot" :: held 3.817s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-193e42ed-875f-497e-b00a-28b21266b18b" released by "delete_snapshot" :: held 3.842s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Created reservations ['e5bada45-96f3-4ade-a537-5c02f77ac49f', '3ff5b5d7-334e-4140-9f05-84fae7f9f132', '87bf499a-c89b-4283-b3d9-5a8411623149', '835651c6-a518-43c8-8b20-ec238c70ac20'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:03 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Delete snapshot completed successfully. Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-d2b25476-0ca5-40ad-bcd5-fc991aaacaf5-delete_snapshot" released by "delete_snapshot" :: held 4.041s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Snapshots deleted, issuing volume delete {{(pid=86459) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-193e42ed-875f-497e-b00a-28b21266b18b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-193e42ed-875f-497e-b00a-28b21266b18b" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:03 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78" returned: 0 in 0.930s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fd81ad-82ef-4c05-9721-047d6fd430fe]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:03 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78 Jul 05 17:30:03 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:03 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4" returned: 0 in 0.921s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:03 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4 Jul 05 17:30:03 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:03 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b Jul 05 17:30:03 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:04 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715.6ca15ab6-2b40-49de-9c57-03a3ded81f78" returned: 0 in 0.729s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-quobyte-6ca15ab6-2b40-49de-9c57-03a3ded81f78" released by "_delete_snapshot" :: held 3.579s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-quobyte-f309ef34-a3a2-4d16-8dca-3d318910b715" released by "delete_snapshot" :: held 3.605s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Created reservations ['ed6e0d44-47d1-4299-bf67-2b54662a3452', '8408ff01-da0f-4105-a21e-b6f0b2a0af09', '7bf36cfe-6df2-4f7f-8e73-ab294008a763', '759d006e-363f-47ce-bfd9-9ebdd0dcb1f5'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:04 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b" returned: 0 in 0.854s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:04 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-91963cc4-13b3-483f-95a8-8169842788c4" returned: 0 in 0.788s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:04 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b Jul 05 17:30:04 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Lock "cinder-quobyte-91963cc4-13b3-483f-95a8-8169842788c4" released by "delete_volume" :: held 1.759s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Delete snapshot completed successfully. Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92523c51-d2e2-4d31-ae0a-a31e8fedc5f2 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-6ca15ab6-2b40-49de-9c57-03a3ded81f78-delete_snapshot" released by "delete_snapshot" :: held 3.790s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Created reservations ['052346c4-a151-4932-a561-ead157f86752', '15552178-a0f2-482b-90da-6bf1816687af', '5ae3cf29-0230-4bc2-88cf-e08accc70cef', 'd43b6744-73d6-473e-adcd-fa7b0e1a8f78'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:04 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:30:04 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "cinder-f309ef34-a3a2-4d16-8dca-3d318910b715-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-f309ef34-a3a2-4d16-8dca-3d318910b715-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:05 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "cinder-quobyte-f309ef34-a3a2-4d16-8dca-3d318910b715" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-193e42ed-875f-497e-b00a-28b21266b18b" returned: 0 in 0.727s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-193e42ed-875f-497e-b00a-28b21266b18b" released by "delete_volume" :: held 1.656s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-quobyte-f309ef34-a3a2-4d16-8dca-3d318910b715" acquired by "delete_volume" :: waited 0.037s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[90081b63-6ebe-4f31-a526-eaa5e601694b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Created reservations ['70ee3203-b472-439f-b86f-6518dd8115dd', '9d624602-b5bb-439d-9952-17236ec23666', 'e05cf091-5156-47e9-a641-b908484901a9', '1b490ea0-6fc7-4624-b3fc-d899389cb5d5'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:05 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.746s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:30:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Deleted volume successfully. Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:05 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 Jul 05 17:30:05 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5b4c2bfd-b835-437a-a6cb-fd7679ef728a tempest-VolumesActionsTest-1482641577 None] Lock "cinder-91963cc4-13b3-483f-95a8-8169842788c4-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:05 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:30:05 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-81a70138-a547-4922-a865-8caf44f0bd29-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:06 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.873s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-81a70138-a547-4922-a865-8caf44f0bd29-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Deleted volume successfully. Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f5e1522d-d2ba-4fce-a467-246e9aab6cc0 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-193e42ed-875f-497e-b00a-28b21266b18b-delete_volume" released by "delete_volume" :: held 6.901s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "cinder-quobyte-81a70138-a547-4922-a865-8caf44f0bd29" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-81a70138-a547-4922-a865-8caf44f0bd29" acquired by "delete_volume" :: waited 0.037s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f1e0f-0026-4107-bec9-2f32293fead2]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:06 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715" returned: 0 in 1.191s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:06 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715 Jul 05 17:30:06 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:06 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 Jul 05 17:30:06 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:07 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f309ef34-a3a2-4d16-8dca-3d318910b715" returned: 0 in 0.848s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-quobyte-f309ef34-a3a2-4d16-8dca-3d318910b715" released by "delete_volume" :: held 2.144s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:07 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29" returned: 0 in 0.984s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:07 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29 Jul 05 17:30:07 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Created reservations ['59ecd48a-5c91-447d-b7b1-4a35fb62dc94', 'ba333adf-33ac-4ad0-936c-9c87dd81104b', 'd21b0259-8210-4545-a98e-869dc42bfba1', 'b0b0323e-25cf-46ae-887c-0c6c69896c98'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:07 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:30:07 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:08 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81a70138-a547-4922-a865-8caf44f0bd29" returned: 0 in 0.816s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-quobyte-81a70138-a547-4922-a865-8caf44f0bd29" released by "delete_volume" :: held 1.866s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Created reservations ['511eda4c-d32a-4d1d-801c-e0e34e37ac48', '71558816-3190-46b6-9bd8-d755e820a8ed', '55916938-db66-484c-a8d5-cc3c2e5c9d14', '093fb99c-2d9f-432c-8ce5-370ccd1d3f2e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:08 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.755s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:30:08 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Deleted volume successfully. Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-63f2dfca-119d-4a63-8ba7-ec7b086dac10 tempest-VolumesExtendTest-1129158519 None] Lock "cinder-f309ef34-a3a2-4d16-8dca-3d318910b715-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:08 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:30:08 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:09 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.178s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:09 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:30:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Deleted volume successfully. Jul 05 17:30:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8af99f2f-422d-48a9-afaf-6c1875f243a6 tempest-VolumesDeleteCascade-9028449 None] Lock "cinder-81a70138-a547-4922-a865-8caf44f0bd29-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (7d2dc1f1-c18a-4385-8258-e04042ec66b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e719a7bd-fab1-4f1e-adeb-0cd23e8bfb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e719a7bd-fab1-4f1e-adeb-0cd23e8bfb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-894880455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8419916-b351-42be-8615-fbde79170356,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:13Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2191b000-4849-4633-b09f-e80f4ad33185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2191b000-4849-4633-b09f-e80f4ad33185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e7996d-2fde-4db4-aed0-484ce6e15eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e7996d-2fde-4db4-aed0-484ce6e15eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8419916-b351-42be-8615-fbde79170356', 'volume_name': 'volume-b8419916-b351-42be-8615-fbde79170356', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18ede07-079d-413b-93df-5c2a888323c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18ede07-079d-413b-93df-5c2a888323c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3c78ab-3cf8-49a5-a8a2-b7b094873cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:13 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Volume b8419916-b351-42be-8615-fbde79170356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8419916-b351-42be-8615-fbde79170356', 'volume_size': 1} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-894880455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8419916-b351-42be-8615-fbde79170356,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:13Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Creating volume b8419916-b351-42be-8615-fbde79170356 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:13 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:13 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 1073741824 Jul 05 17:30:13 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:14 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 1073741824" returned: 0 in 1.103s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:14 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 Jul 05 17:30:14 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:15 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3c78ab-3cf8-49a5-a8a2-b7b094873cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8419916-b351-42be-8615-fbde79170356', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38029080-e2a8-4f38-83cb-05bf7fe95277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:15 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Volume volume-b8419916-b351-42be-8615-fbde79170356 (b8419916-b351-42be-8615-fbde79170356): created successfully Jul 05 17:30:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38029080-e2a8-4f38-83cb-05bf7fe95277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (7d2dc1f1-c18a-4385-8258-e04042ec66b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:15 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-432c4822-4b8e-4c85-83e6-cadf050b4bf2 tempest-VolumesGetTest-59864492 None] Created volume successfully. Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (056dd2eb-d5c9-4e28-8fc3-3b03cf97431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd8008d-9a66-481e-a218-26dedfc2e995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd8008d-9a66-481e-a218-26dedfc2e995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-332865831',display_name='tempest-VolumesGetTest-Volume-219794168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6687b1-df31-4068-82a9-ccbd569b6820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:18Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39b3d63-3140-416c-ab3d-be23fc41ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39b3d63-3140-416c-ab3d-be23fc41ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215265e1-699b-491e-9fff-983f8fa8c705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215265e1-699b-491e-9fff-983f8fa8c705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6687b1-df31-4068-82a9-ccbd569b6820', 'volume_name': 'volume-bb6687b1-df31-4068-82a9-ccbd569b6820', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eedf6a2-8d3e-467d-978f-fdaaa7f9e7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eedf6a2-8d3e-467d-978f-fdaaa7f9e7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ed1cb5-f39d-40e5-8f08-dc7c2a231cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:17 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Volume bb6687b1-df31-4068-82a9-ccbd569b6820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6687b1-df31-4068-82a9-ccbd569b6820', 'volume_size': 1} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-332865831',display_name='tempest-VolumesGetTest-Volume-219794168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6687b1-df31-4068-82a9-ccbd569b6820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:18Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Creating volume bb6687b1-df31-4068-82a9-ccbd569b6820 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:17 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:17 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 1073741824 Jul 05 17:30:17 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:18 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 1073741824" returned: 0 in 1.020s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:18 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 Jul 05 17:30:18 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:19 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820" returned: 0 in 0.896s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ed1cb5-f39d-40e5-8f08-dc7c2a231cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6687b1-df31-4068-82a9-ccbd569b6820', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3809032-67d6-4b08-9711-5899a435d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:19 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Volume volume-bb6687b1-df31-4068-82a9-ccbd569b6820 (bb6687b1-df31-4068-82a9-ccbd569b6820): created successfully Jul 05 17:30:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3809032-67d6-4b08-9711-5899a435d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (056dd2eb-d5c9-4e28-8fc3-3b03cf97431b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-42ede862-485a-40da-9b27-751002361ca2 tempest-VolumesGetTest-59864492 None] Created volume successfully. Jul 05 17:30:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-bb6687b1-df31-4068-82a9-ccbd569b6820-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Lock "cinder-bb6687b1-df31-4068-82a9-ccbd569b6820-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-bb6687b1-df31-4068-82a9-ccbd569b6820" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-bb6687b1-df31-4068-82a9-ccbd569b6820" acquired by "delete_volume" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:21 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54d029e-7939-4a6e-a46f-acad704562e4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:21 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 Jul 05 17:30:21 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:22 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820" returned: 0 in 1.098s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:22 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820 Jul 05 17:30:22 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:23 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bb6687b1-df31-4068-82a9-ccbd569b6820" returned: 0 in 1.005s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-bb6687b1-df31-4068-82a9-ccbd569b6820" released by "delete_volume" :: held 2.175s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Created reservations ['454d1ccd-4bbb-44a1-8cec-78370cf9aa2d', 'd66721a6-8d6e-4672-8caa-ee2c98ca2e71', '2f3a297e-4021-4798-8cdc-bbfaf5f36911', 'fbd4592f-a1d8-4382-b683-10f871dd5e64'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:23 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:30:23 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Flow 'volume_create_manager' (ec5a7d61-7871-46cb-bba4-7e30cc0984be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdf087b-a297-4e7e-bfb6-a320ff73c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdf087b-a297-4e7e-bfb6-a320ff73c027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-843052959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d947037b-75f2-4d30-b836-8c1956fd4572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff81eb96e3a349a78688a962a7b921d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:23Z,use_quota=True,user_id='b4281bc705f1426f8fb444f8375efc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f123a4d2-aaff-478d-bb12-95196251f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f123a4d2-aaff-478d-bb12-95196251f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468e177a-95b2-4639-ae3b-4e8f85cc0e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468e177a-95b2-4639-ae3b-4e8f85cc0e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd947037b-75f2-4d30-b836-8c1956fd4572', 'volume_name': 'volume-d947037b-75f2-4d30-b836-8c1956fd4572', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa79fc1d-14ef-4771-803c-a2084c84a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa79fc1d-14ef-4771-803c-a2084c84a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73163a0-3ec5-48e8-bf90-bfcaf33a23e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:23 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Volume d947037b-75f2-4d30-b836-8c1956fd4572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d947037b-75f2-4d30-b836-8c1956fd4572', 'volume_size': 1} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-843052959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d947037b-75f2-4d30-b836-8c1956fd4572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff81eb96e3a349a78688a962a7b921d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:23Z,use_quota=True,user_id='b4281bc705f1426f8fb444f8375efc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Creating volume d947037b-75f2-4d30-b836-8c1956fd4572 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:23 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:23 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 1073741824 Jul 05 17:30:23 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:24 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.035s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:30:24 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Deleted volume successfully. Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce5f26ec-83ad-45cb-8aff-ac0da35328b6 tempest-VolumesGetTest-59864492 None] Lock "cinder-bb6687b1-df31-4068-82a9-ccbd569b6820-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-b8419916-b351-42be-8615-fbde79170356-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Lock "cinder-b8419916-b351-42be-8615-fbde79170356-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-b8419916-b351-42be-8615-fbde79170356" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-b8419916-b351-42be-8615-fbde79170356" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcad9aca-59ed-4403-ab80-1e030de416c4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:24 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 Jul 05 17:30:24 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:24 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 1073741824" returned: 0 in 1.225s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:25 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 Jul 05 17:30:25 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (23daeeb9-4025-44f4-a4c5-aeb7519ee9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9600e42b-2c86-4941-9dbc-ba6be808f241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9600e42b-2c86-4941-9dbc-ba6be808f241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1582042303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5c0b6b-f869-4b35-ab65-08234647535e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5e20b653bd41a8b5ef398cba6608d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:25Z,use_quota=True,user_id='0da692f4f5d548838d8972a29e146c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593aa2ae-be8a-4510-b3a2-36abd1c951dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593aa2ae-be8a-4510-b3a2-36abd1c951dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f6c321-89fb-4951-afa3-981bdb6ac182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f6c321-89fb-4951-afa3-981bdb6ac182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5c0b6b-f869-4b35-ab65-08234647535e', 'volume_name': 'volume-ff5c0b6b-f869-4b35-ab65-08234647535e', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34521894-b9ac-4f4f-93df-bfc4d8195ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34521894-b9ac-4f4f-93df-bfc4d8195ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5bc22e-ba73-4a85-a6f7-299488068d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:25 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Volume ff5c0b6b-f869-4b35-ab65-08234647535e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5c0b6b-f869-4b35-ab65-08234647535e', 'volume_size': 1} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:25 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356" returned: 0 in 0.928s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:25 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356 Jul 05 17:30:25 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:25 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572" returned: 0 in 0.784s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1582042303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5c0b6b-f869-4b35-ab65-08234647535e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5e20b653bd41a8b5ef398cba6608d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:25Z,use_quota=True,user_id='0da692f4f5d548838d8972a29e146c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Creating volume ff5c0b6b-f869-4b35-ab65-08234647535e {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:25 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73163a0-3ec5-48e8-bf90-bfcaf33a23e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d947037b-75f2-4d30-b836-8c1956fd4572', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:25 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e 1073741824 Jul 05 17:30:25 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d4029f-c3a5-48c8-8c94-aa831aa012ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:25 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Volume volume-d947037b-75f2-4d30-b836-8c1956fd4572 (d947037b-75f2-4d30-b836-8c1956fd4572): created successfully Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d4029f-c3a5-48c8-8c94-aa831aa012ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Flow 'volume_create_manager' (ec5a7d61-7871-46cb-bba4-7e30cc0984be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a35380e2-e7e1-40f9-a081-f2114dcb7768 tempest-VolumesListAdminTestJSON-1918724121 None] Created volume successfully. Jul 05 17:30:26 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8419916-b351-42be-8615-fbde79170356" returned: 0 in 0.778s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-b8419916-b351-42be-8615-fbde79170356" released by "delete_volume" :: held 1.768s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Created reservations ['787303a1-0f74-4b04-ba9d-50fd0a7b1561', '05457ad2-f81e-4978-ac0f-def7f317a205', 'd784dee1-a15c-4731-b223-ff1134af818b', '6a251c34-1949-4f0e-b5b2-71fdbeca8ea4'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:26 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:30:26 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:26 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e 1073741824" returned: 0 in 0.997s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:26 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e Jul 05 17:30:26 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Flow 'volume_create_manager' (56876170-79e5-4f77-bbd8-8cc0e33ebbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cdd6e9-3901-49c7-b16d-3eae3366fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cdd6e9-3901-49c7-b16d-3eae3366fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1199917808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8864d331-40a4-4a67-b5d0-ffb16b4180a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff81eb96e3a349a78688a962a7b921d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:28Z,use_quota=True,user_id='b4281bc705f1426f8fb444f8375efc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3de096-def0-4ac5-a047-558a75df0cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3de096-def0-4ac5-a047-558a75df0cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015cc309-d60b-4ade-a8b2-ab155a9b9a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015cc309-d60b-4ade-a8b2-ab155a9b9a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8864d331-40a4-4a67-b5d0-ffb16b4180a9', 'volume_name': 'volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4877b20-620a-47e5-b705-4f4e9bb76c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4877b20-620a-47e5-b705-4f4e9bb76c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c72d76e-649e-4847-b67b-5303f5945007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Volume 8864d331-40a4-4a67-b5d0-ffb16b4180a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9', 'volume_size': 1} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:27 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.103s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:30:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Deleted volume successfully. Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042271c5-80b0-4ef7-9b89-90832ae48102 tempest-VolumesGetTest-59864492 None] Lock "cinder-b8419916-b351-42be-8615-fbde79170356-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (18909e3b-2f72-41d0-8f8b-373e89a9c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3a3a86-f765-4530-a386-420b7750348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3a3a86-f765-4530-a386-420b7750348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-398409906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7f2871-60f5-44d1-be06-2927b297b97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:28Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11109395-1c84-471c-8cf3-7e9a7444ce52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11109395-1c84-471c-8cf3-7e9a7444ce52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f81050-3e49-49be-bbae-8cb774a73aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f81050-3e49-49be-bbae-8cb774a73aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7f2871-60f5-44d1-be06-2927b297b97b', 'volume_name': 'volume-ed7f2871-60f5-44d1-be06-2927b297b97b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5be769-1a8d-4349-8a59-4f45016e668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5be769-1a8d-4349-8a59-4f45016e668a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ce6dc2-6afe-4194-9eee-6a9b89116479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:27 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Volume ed7f2871-60f5-44d1-be06-2927b297b97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7f2871-60f5-44d1-be06-2927b297b97b', 'volume_size': 1} Jul 05 17:30:27 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e" returned: 0 in 1.053s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.219s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1199917808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8864d331-40a4-4a67-b5d0-ffb16b4180a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff81eb96e3a349a78688a962a7b921d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:28Z,use_quota=True,user_id='b4281bc705f1426f8fb444f8375efc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Creating volume 8864d331-40a4-4a67-b5d0-ffb16b4180a9 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:27 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:28 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 1073741824 Jul 05 17:30:28 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5bc22e-ba73-4a85-a6f7-299488068d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5c0b6b-f869-4b35-ab65-08234647535e', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7d8a18-c10d-49c9-817b-e35e562bb516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:28 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Volume volume-ff5c0b6b-f869-4b35-ab65-08234647535e (ff5c0b6b-f869-4b35-ab65-08234647535e): created successfully Jul 05 17:30:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7d8a18-c10d-49c9-817b-e35e562bb516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (23daeeb9-4025-44f4-a4c5-aeb7519ee9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:28 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fec3d429-f630-46fc-96fb-a0d5a2c281ec tempest-VolumesSnapshotTestJSON-691700133 None] Created volume successfully. Jul 05 17:30:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:28 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 1073741824" returned: 0 in 0.896s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:28 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 Jul 05 17:30:28 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:29 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9" returned: 0 in 0.826s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.777s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-398409906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7f2871-60f5-44d1-be06-2927b297b97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:28Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Creating volume ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:29 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c72d76e-649e-4847-b67b-5303f5945007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:29 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b 1073741824 Jul 05 17:30:29 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2b1c2c-f8c1-4f7a-9309-3f13764b9410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:29 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Volume volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 (8864d331-40a4-4a67-b5d0-ffb16b4180a9): created successfully Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2b1c2c-f8c1-4f7a-9309-3f13764b9410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Flow 'volume_create_manager' (56876170-79e5-4f77-bbd8-8cc0e33ebbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e0bb2e16-0d4b-480f-a8fc-434ff5441e81 tempest-VolumesListAdminTestJSON-1918724121 None] Created volume successfully. Jul 05 17:30:30 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b 1073741824" returned: 0 in 1.080s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:30 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b Jul 05 17:30:30 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Flow 'volume_create_manager' (3c79352c-d93b-4c4e-b157-6e27d2e770fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d02c47-89e6-4a28-8836-2cc072605503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d02c47-89e6-4a28-8836-2cc072605503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1053599072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56286f7d-cd0b-41e1-8749-f21dd0f0d602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff81eb96e3a349a78688a962a7b921d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:31Z,use_quota=True,user_id='b4281bc705f1426f8fb444f8375efc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222dfb9b-7b5a-4acf-bd6d-b36de0720d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222dfb9b-7b5a-4acf-bd6d-b36de0720d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e52c41c-efe1-491c-a6d5-11589aaff6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e52c41c-efe1-491c-a6d5-11589aaff6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56286f7d-cd0b-41e1-8749-f21dd0f0d602', 'volume_name': 'volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1f922c-d96d-492b-9eea-c7093ba331eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1f922c-d96d-492b-9eea-c7093ba331eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3711a23-5964-41c0-bf16-40e2e2739771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:31 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Volume 56286f7d-cd0b-41e1-8749-f21dd0f0d602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602', 'volume_size': 1} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:31 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b" returned: 0 in 0.831s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.076s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ce6dc2-6afe-4194-9eee-6a9b89116479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7f2871-60f5-44d1-be06-2927b297b97b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd1412c-4068-4b2d-aad9-e892d57ea2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Creating offline snapshot 46530a1c-de92-4f9b-a459-9dc75c2186c1 of volume ff5c0b6b-f869-4b35-ab65-08234647535e {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:30:31 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Volume volume-ed7f2871-60f5-44d1-be06-2927b297b97b (ed7f2871-60f5-44d1-be06-2927b297b97b): created successfully Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd1412c-4068-4b2d-aad9-e892d57ea2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (18909e3b-2f72-41d0-8f8b-373e89a9c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee14563-7ac6-404d-be1f-69c0fdf636b8]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-bc4b3e39-dd0c-46af-9610-975a195c6746 tempest-VolumesGetTest-59864492 None] Created volume successfully. Jul 05 17:30:31 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e Jul 05 17:30:31 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (471318cf-296b-427a-b74f-132a19ce31d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39967b4f-723c-4997-bd4f-f3606e5f6bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39967b4f-723c-4997-bd4f-f3606e5f6bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-960087789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd8d6ee-5689-4d4c-8174-e897723598e1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ed7f2871-60f5-44d1-be06-2927b297b97b,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:33Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182d3e2d-6f95-4621-87ab-0d8d98a1c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:32 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182d3e2d-6f95-4621-87ab-0d8d98a1c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c71d2a-d8e6-4f80-8aad-7bbe52b3c60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e" returned: 0 in 0.936s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:32 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 1G Jul 05 17:30:32 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c71d2a-d8e6-4f80-8aad-7bbe52b3c60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3bd8d6ee-5689-4d4c-8174-e897723598e1', 'volume_name': 'volume-3bd8d6ee-5689-4d4c-8174-e897723598e1', 'volume_size': 1, 'source_volid': 'ed7f2871-60f5-44d1-be06-2927b297b97b', 'source_volstatus': 'available'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0914ed-3a18-431e-b0e9-02b83c76e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0914ed-3a18-431e-b0e9-02b83c76e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6005c091-6d91-4e16-a340-3e837e69ee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:32 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Volume 3bd8d6ee-5689-4d4c-8174-e897723598e1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3bd8d6ee-5689-4d4c-8174-e897723598e1', 'volume_size': 1, 'source_volid': 'ed7f2871-60f5-44d1-be06-2927b297b97b', 'source_volstatus': 'available'} Jul 05 17:30:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:33 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 1G" returned: 0 in 0.843s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5c0b6b-f869-4b35-ab65-08234647535e -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:33 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5c0b6b-f869-4b35-ab65-08234647535e -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 Jul 05 17:30:33 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:34 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5c0b6b-f869-4b35-ab65-08234647535e -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1" returned: 0 in 0.791s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:34 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 is being set with open permissions: ugo+rw Jul 05 17:30:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:34 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 Jul 05 17:30:34 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:35 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1" returned: 0 in 0.711s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:35 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.info Jul 05 17:30:35 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:35 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.info" returned: 0 in 0.692s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:35 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.info is being set with open permissions: ugo+rw Jul 05 17:30:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:35 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.info Jul 05 17:30:35 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:36 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.info" returned: 0 in 0.690s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.788s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.086s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1053599072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56286f7d-cd0b-41e1-8749-f21dd0f0d602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff81eb96e3a349a78688a962a7b921d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:31Z,use_quota=True,user_id='b4281bc705f1426f8fb444f8375efc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Creating volume 56286f7d-cd0b-41e1-8749-f21dd0f0d602 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:36 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:36 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=93,cinder:UPDATE=126,cinder:DELETE=11,cinder:INSERT=24 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:30:36 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 1073741824 Jul 05 17:30:36 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9edd81f9-8d1b-4523-ad42-bd3cacc61d3c tempest-VolumesSnapshotTestJSON-691700133 None] Create snapshot completed successfully Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-46530a1c-de92-4f9b-a459-9dc75c2186c1-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-46530a1c-de92-4f9b-a459-9dc75c2186c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-ff5c0b6b-f869-4b35-ab65-08234647535e" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-ff5c0b6b-f869-4b35-ab65-08234647535e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-46530a1c-de92-4f9b-a459-9dc75c2186c1" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-46530a1c-de92-4f9b-a459-9dc75c2186c1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Deleting offline snapshot 46530a1c-de92-4f9b-a459-9dc75c2186c1 of volume ff5c0b6b-f869-4b35-ab65-08234647535e {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] snapshot_file for this snap is: volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d062e9-dcc1-4394-8181-478f040e7bf8]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:37 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 Jul 05 17:30:37 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:37 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 1073741824" returned: 0 in 0.952s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:37 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 Jul 05 17:30:37 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:38 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1" returned: 0 in 0.900s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff5c0b6b-f869-4b35-ab65-08234647535e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7763065-c996-45e5-9035-3bf7fd8d8a30]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:38 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602" returned: 0 in 0.710s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.452s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:38 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Cloning volume ed7f2871-60f5-44d1-be06-2927b297b97b to volume 3bd8d6ee-5689-4d4c-8174-e897723598e1 Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3711a23-5964-41c0-bf16-40e2e2739771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a62572f-07cb-4028-9827-69e8c84fa35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:38 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Volume volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 (56286f7d-cd0b-41e1-8749-f21dd0f0d602): created successfully Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a62572f-07cb-4028-9827-69e8c84fa35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Flow 'volume_create_manager' (3c79352c-d93b-4c4e-b157-6e27d2e770fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Creating offline snapshot 4bb573ee-0b81-46d9-9e3a-d592966aeb00 of volume ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:30:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4c882da4-478c-4562-aa0f-f33381502ce4 tempest-VolumesListAdminTestJSON-1918724121 None] Created volume successfully. Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28c782-68d6-4d73-8e20-830fbeba17cd]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:38 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e Jul 05 17:30:38 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:38 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b Jul 05 17:30:38 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:39 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e" returned: 0 in 0.907s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:39 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 Jul 05 17:30:39 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:39 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b" returned: 0 in 1.029s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:39 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 1G Jul 05 17:30:39 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:40 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Flow 'volume_create_manager' (f86d4bca-3f90-46f7-8ea3-e1415748cdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fbdf3a-14be-4bad-96c2-118c54fd8496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1" returned: 0 in 1.135s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:40 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1 Jul 05 17:30:40 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fbdf3a-14be-4bad-96c2-118c54fd8496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bedb64-8931-4517-af8f-3a1ce153a128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f2eeebaad34077b9de6430d0e595f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:40Z,use_quota=True,user_id='ca1dab4b45b54a929719dc8fca20c609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9166356d-719e-4dc4-b10a-3d551ac9af9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9166356d-719e-4dc4-b10a-3d551ac9af9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef25d5f-4cee-4305-aedc-d1a27f45e5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef25d5f-4cee-4305-aedc-d1a27f45e5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2bedb64-8931-4517-af8f-3a1ce153a128', 'volume_name': 'volume-c2bedb64-8931-4517-af8f-3a1ce153a128', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa55cdce-c9f1-4853-a19a-c92f2c7462da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa55cdce-c9f1-4853-a19a-c92f2c7462da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b618b91-6acc-446c-aaf0-4f19eb36cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Volume c2bedb64-8931-4517-af8f-3a1ce153a128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2bedb64-8931-4517-af8f-3a1ce153a128', 'volume_size': 1} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:40 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 1G" returned: 0 in 1.218s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7f2871-60f5-44d1-be06-2927b297b97b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:40 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7f2871-60f5-44d1-be06-2927b297b97b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 Jul 05 17:30:40 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:41 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e.46530a1c-de92-4f9b-a459-9dc75c2186c1" returned: 0 in 0.842s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-46530a1c-de92-4f9b-a459-9dc75c2186c1" released by "_delete_snapshot" :: held 3.919s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-ff5c0b6b-f869-4b35-ab65-08234647535e" released by "delete_snapshot" :: held 3.948s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:41 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Created reservations ['11cd1a50-1acf-4f2e-baa6-9eaa565e5883', '070a6608-98fe-4911-9c2e-6536d7271cdd', '3cbde9a4-d15e-4363-881b-31b412bf8a8c', 'dd3234a0-d285-4083-a8d5-2dd70ccd52af'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:30:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Delete snapshot completed successfully. Jul 05 17:30:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0a60a475-8860-4d71-aae6-06b768563c8f tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-46530a1c-de92-4f9b-a459-9dc75c2186c1-delete_snapshot" released by "delete_snapshot" :: held 4.180s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:41 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7f2871-60f5-44d1-be06-2927b297b97b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00" returned: 0 in 0.805s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:41 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 is being set with open permissions: ugo+rw Jul 05 17:30:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:41 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 Jul 05 17:30:41 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (893e4023-1cf7-42b4-9487-3934471a961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb63f93b-2928-4f5c-bf06-b4e15d6d4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb63f93b-2928-4f5c-bf06-b4e15d6d4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-888163800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88167f5-c011-4c52-ac95-8e1a0c2f4f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5e20b653bd41a8b5ef398cba6608d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:42Z,use_quota=True,user_id='0da692f4f5d548838d8972a29e146c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ea15d2-7fc3-4376-9019-5ea01f9e9363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ea15d2-7fc3-4376-9019-5ea01f9e9363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226fcc3d-1e68-41b3-9dcb-30af256ebfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226fcc3d-1e68-41b3-9dcb-30af256ebfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88167f5-c011-4c52-ac95-8e1a0c2f4f14', 'volume_name': 'volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf7968f-8571-4090-92ef-1ef0bbfaeefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf7968f-8571-4090-92ef-1ef0bbfaeefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480d9686-49b2-4549-82c2-73663fdaa1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:42 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Volume e88167f5-c011-4c52-ac95-8e1a0c2f4f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14', 'volume_size': 1} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:42 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00" returned: 0 in 0.985s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:42 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.info Jul 05 17:30:42 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:43 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.info" returned: 0 in 0.746s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:43 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.info is being set with open permissions: ugo+rw Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:43 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.info Jul 05 17:30:43 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:43 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.info" returned: 0 in 0.667s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-3bd8d6ee-5689-4d4c-8174-e897723598e1" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-3bd8d6ee-5689-4d4c-8174-e897723598e1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] snapshot: 4bb573ee-0b81-46d9-9e3a-d592966aeb00, volume: 3bd8d6ee-5689-4d4c-8174-e897723598e1, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5770dcd-ba8f-44a8-adc5-2dc2f3b24e06]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:44 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 Jul 05 17:30:44 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:44 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00" returned: 0 in 0.818s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7f2871-60f5-44d1-be06-2927b297b97b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:30:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:30:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:30:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaf5188-71b6-44c8-af20-87ea654040ab]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:44 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b Jul 05 17:30:44 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:45 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b" returned: 0 in 0.822s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:45 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:30:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:45 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 Jul 05 17:30:45 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Flow 'volume_create_manager' (edbc455e-751a-416e-b3f3-a73139afe0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a34f26-be1f-4dc9-8c30-238ec6395bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a34f26-be1f-4dc9-8c30-238ec6395bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1963598775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a99ec33-c1ee-4ab7-9755-11b1656cfab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318c2043fbc4bfc89f9c59bb61b8115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:46Z,use_quota=True,user_id='52e64ba7bbdf4fa5bf06f5cb5513d63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a1ceb7-084a-45d4-9666-a6668d7d3848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a1ceb7-084a-45d4-9666-a6668d7d3848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20a2ca3-aa30-41c1-adf3-982441836766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20a2ca3-aa30-41c1-adf3-982441836766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a99ec33-c1ee-4ab7-9755-11b1656cfab5', 'volume_name': 'volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e76ac9a-4184-404f-a668-d2b844be3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e76ac9a-4184-404f-a668-d2b844be3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a04aede-5bc2-4e44-9bfa-33b39762db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Volume 5a99ec33-c1ee-4ab7-9755-11b1656cfab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5', 'volume_size': 1} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Flow 'volume_create_manager' (51648a4b-06b6-496a-98b9-3021099128b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdf9a99-eef0-4953-b5e1-b100d770fce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdf9a99-eef0-4953-b5e1-b100d770fce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-99490851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebd8efe-4f0e-476e-94b6-aea4de773ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318c2043fbc4bfc89f9c59bb61b8115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:46Z,use_quota=True,user_id='52e64ba7bbdf4fa5bf06f5cb5513d63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3667c6-a101-42f4-8e64-705382b8d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3667c6-a101-42f4-8e64-705382b8d286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811ca374-add1-4e2d-ae33-adb2e9d060a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811ca374-add1-4e2d-ae33-adb2e9d060a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebd8efe-4f0e-476e-94b6-aea4de773ebe', 'volume_name': 'volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b947a9a6-5ec9-4cc2-b734-d49559e0463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b947a9a6-5ec9-4cc2-b734-d49559e0463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45890916-561f-4847-9aeb-f31b1af36ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:46 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Volume 6ebd8efe-4f0e-476e-94b6-aea4de773ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe', 'volume_size': 1} Jul 05 17:30:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:30:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:50 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:30:50 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:51 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1" returned: 0 in 5.601s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:51 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d334b596-8722-440a-82a6-2d0283717f06]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:51 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b Jul 05 17:30:51 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:51 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.883s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:30:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:30:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:30:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:30:52 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b" returned: 0 in 0.997s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:30:52 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Converted 1024.00 MB image at 182.79 MB/s Jul 05 17:30:52 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 is being set with open permissions: ugo+rw Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:52 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 Jul 05 17:30:52 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:52 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1" returned: 0 in 0.656s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-3bd8d6ee-5689-4d4c-8174-e897723598e1" released by "_copy_volume_from_snapshot" :: held 9.006s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-4bb573ee-0b81-46d9-9e3a-d592966aeb00" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-4bb573ee-0b81-46d9-9e3a-d592966aeb00" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Deleting offline snapshot 4bb573ee-0b81-46d9-9e3a-d592966aeb00 of volume ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] snapshot_file for this snap is: volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5dde1a-6417-49c2-963c-dbf74ef40888]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:53 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 Jul 05 17:30:53 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:53 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00" returned: 0 in 0.756s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7f2871-60f5-44d1-be06-2927b297b97b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:30:53 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce25f38-2faa-4ca9-b4e8-53065f7cabf5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:53 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b Jul 05 17:30:53 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:54 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b" returned: 0 in 0.774s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:54 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 Jul 05 17:30:54 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:55 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00" returned: 0 in 0.707s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:55 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00 Jul 05 17:30:55 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:55 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b.4bb573ee-0b81-46d9-9e3a-d592966aeb00" returned: 0 in 0.661s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-4bb573ee-0b81-46d9-9e3a-d592966aeb00" released by "_delete_snapshot" :: held 2.979s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.682s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.560s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bedb64-8931-4517-af8f-3a1ce153a128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f2eeebaad34077b9de6430d0e595f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:40Z,use_quota=True,user_id='ca1dab4b45b54a929719dc8fca20c609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Creating volume c2bedb64-8931-4517-af8f-3a1ce153a128 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:55 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:55 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 1073741824 Jul 05 17:30:55 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6005c091-6d91-4e16-a340-3e837e69ee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd8d6ee-5689-4d4c-8174-e897723598e1', 'volume_size': 1, 'source_volid': 'ed7f2871-60f5-44d1-be06-2927b297b97b', 'source_volstatus': 'available'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17d0c2e-aabc-4813-9d19-fc01a710dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:55 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Volume volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 (3bd8d6ee-5689-4d4c-8174-e897723598e1): created successfully Jul 05 17:30:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17d0c2e-aabc-4813-9d19-fc01a710dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (471318cf-296b-427a-b74f-132a19ce31d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:56 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-cdc37b54-9835-4108-a1ad-4bb04739cdb5 tempest-VolumesGetTest-59864492 None] Created volume successfully. Jul 05 17:30:56 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 1073741824" returned: 0 in 0.920s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:56 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 Jul 05 17:30:56 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (99f503cb-3907-41a8-b0bd-3f945fa404c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84505c6-c2a9-42c0-bc18-5b06dd354e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84505c6-c2a9-42c0-bc18-5b06dd354e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073482022',display_name='tempest-VolumesGetTest-Volume-956769920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ab916a-cf5f-4de7-8faf-2816fe83b5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:57Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9eae717-071b-4c7f-ab1e-6d44769ff7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9eae717-071b-4c7f-ab1e-6d44769ff7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e595b5-ba1a-4d0f-b39c-4f7219623d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e595b5-ba1a-4d0f-b39c-4f7219623d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ab916a-cf5f-4de7-8faf-2816fe83b5bb', 'volume_name': 'volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046f24d7-5ae8-4fae-a479-7795798693a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046f24d7-5ae8-4fae-a479-7795798693a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dc6911-e060-4e9a-af71-94aebe8a9f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Volume 33ab916a-cf5f-4de7-8faf-2816fe83b5bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb', 'volume_size': 1} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:57 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128" returned: 0 in 0.761s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.362s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-888163800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88167f5-c011-4c52-ac95-8e1a0c2f4f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5e20b653bd41a8b5ef398cba6608d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:42Z,use_quota=True,user_id='0da692f4f5d548838d8972a29e146c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Creating volume e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:57 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b618b91-6acc-446c-aaf0-4f19eb36cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2bedb64-8931-4517-af8f-3a1ce153a128', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893d76a8-8bcb-4633-9b1f-7609c4dd9542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:57 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 1073741824 Jul 05 17:30:57 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Volume volume-c2bedb64-8931-4517-af8f-3a1ce153a128 (c2bedb64-8931-4517-af8f-3a1ce153a128): created successfully Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893d76a8-8bcb-4633-9b1f-7609c4dd9542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Flow 'volume_create_manager' (f86d4bca-3f90-46f7-8ea3-e1415748cdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-1a1f6bcb-7d46-48de-901a-7e18c8aef5c9 tempest-VolumesListAdminTestJSON-1299922902 None] Created volume successfully. Jul 05 17:30:58 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 1073741824" returned: 0 in 0.941s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Acquiring lock "cinder-c2bedb64-8931-4517-af8f-3a1ce153a128-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "cinder-c2bedb64-8931-4517-af8f-3a1ce153a128-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:58 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 Jul 05 17:30:58 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Acquiring lock "cinder-quobyte-c2bedb64-8931-4517-af8f-3a1ce153a128" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "cinder-quobyte-c2bedb64-8931-4517-af8f-3a1ce153a128" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ccb75-48c8-41d9-a9c3-b3b888b99be7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "cinder-56286f7d-cd0b-41e1-8749-f21dd0f0d602-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-56286f7d-cd0b-41e1-8749-f21dd0f0d602-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "cinder-quobyte-56286f7d-cd0b-41e1-8749-f21dd0f0d602" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-quobyte-56286f7d-cd0b-41e1-8749-f21dd0f0d602" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c58ca8-c07e-4537-bfb7-a5f9110c8ea1]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:30:59 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:59 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:59 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 Jul 05 17:30:59 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:59 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" returned: 0 in 0.959s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.422s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1963598775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a99ec33-c1ee-4ab7-9755-11b1656cfab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318c2043fbc4bfc89f9c59bb61b8115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:46Z,use_quota=True,user_id='52e64ba7bbdf4fa5bf06f5cb5513d63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Creating volume 5a99ec33-c1ee-4ab7-9755-11b1656cfab5 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:30:59 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480d9686-49b2-4549-82c2-73663fdaa1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:59 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 1073741824 Jul 05 17:30:59 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74029e04-37ec-46d2-ab34-41eb9af6e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:30:59 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Volume volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 (e88167f5-c011-4c52-ac95-8e1a0c2f4f14): created successfully Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74029e04-37ec-46d2-ab34-41eb9af6e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (893e4023-1cf7-42b4-9487-3934471a961e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=82,cinder:INSERT=28,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:30:59 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-91e07ce8-1b93-4e68-a5dc-e8e9b62e08f8 tempest-VolumesSnapshotTestJSON-691700133 None] Created volume successfully. Jul 05 17:30:59 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128" returned: 0 in 1.065s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:30:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:30:59 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128 Jul 05 17:30:59 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:30:59 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602" returned: 0 in 0.949s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:00 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602 Jul 05 17:31:00 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:00 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-c2bedb64-8931-4517-af8f-3a1ce153a128" returned: 0 in 0.732s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "cinder-quobyte-c2bedb64-8931-4517-af8f-3a1ce153a128" released by "delete_volume" :: held 1.872s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:00 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 1073741824" returned: 0 in 1.019s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Created reservations ['337068aa-084b-4651-b551-7a5034007584', '41d4a954-75b0-4129-b085-6b45c57ae778', '178a5ea9-0464-4926-82b8-9d93d06e262d', 'dc95184c-8816-425c-8a6d-6b578e91e9ae'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:00 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 Jul 05 17:31:00 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:00 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-56286f7d-cd0b-41e1-8749-f21dd0f0d602" returned: 0 in 0.845s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-quobyte-56286f7d-cd0b-41e1-8749-f21dd0f0d602" released by "delete_volume" :: held 1.859s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:00 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:00 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Created reservations ['028e1715-d40f-4873-b4a4-48979e388b9c', 'ee3e14d2-6ece-43f9-87a5-e8bbed956d93', 'c37d7d0c-07e0-42ca-a966-929847a7f3b3', '711a3bbf-3e98-4035-9365-731b7e56c299'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:01 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:01 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "cinder-8864d331-40a4-4a67-b5d0-ffb16b4180a9-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-8864d331-40a4-4a67-b5d0-ffb16b4180a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "cinder-quobyte-8864d331-40a4-4a67-b5d0-ffb16b4180a9" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-quobyte-8864d331-40a4-4a67-b5d0-ffb16b4180a9" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[813ebfd1-3fa7-4207-ab90-ad858e5501e3]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:01 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5" returned: 0 in 0.854s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.015s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-99490851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebd8efe-4f0e-476e-94b6-aea4de773ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318c2043fbc4bfc89f9c59bb61b8115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:46Z,use_quota=True,user_id='52e64ba7bbdf4fa5bf06f5cb5513d63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Creating volume 6ebd8efe-4f0e-476e-94b6-aea4de773ebe {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:01 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:01 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 Jul 05 17:31:01 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a04aede-5bc2-4e44-9bfa-33b39762db75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:01 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe 1073741824 Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f777eb70-84cb-4d92-9009-86204546198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:01 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:01 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Volume volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 (5a99ec33-c1ee-4ab7-9755-11b1656cfab5): created successfully Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f777eb70-84cb-4d92-9009-86204546198c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Flow 'volume_create_manager' (edbc455e-751a-416e-b3f3-a73139afe0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:01 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e087d0b6-abac-4bb5-aa16-01842ffb6dd4 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Created volume successfully. Jul 05 17:31:01 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.812s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:01 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Deleted volume successfully. Jul 05 17:31:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-692e19e3-bf70-4360-939c-619eb8f6a060 tempest-VolumesListAdminTestJSON-1299922902 None] Lock "cinder-c2bedb64-8931-4517-af8f-3a1ce153a128-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:02 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.928s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:02 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:02 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Deleted volume successfully. Jul 05 17:31:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-09b6848d-1bc7-4a66-8d4c-d1f34424f556 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-56286f7d-cd0b-41e1-8749-f21dd0f0d602-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:02 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9" returned: 0 in 0.850s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:02 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9 Jul 05 17:31:02 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:02 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe 1073741824" returned: 0 in 1.290s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:03 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe Jul 05 17:31:03 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8864d331-40a4-4a67-b5d0-ffb16b4180a9" returned: 0 in 0.998s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:03 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-quobyte-8864d331-40a4-4a67-b5d0-ffb16b4180a9" released by "delete_volume" :: held 1.918s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Created reservations ['5387b0cb-3bfe-4dfd-a47d-42423a50234d', 'f3623835-03e4-4202-a6a4-1c30268c1a38', 'b5fb2e5e-d1e9-4cdb-9c9f-2b281256da71', '8f95a9fd-3472-4564-ae72-94f553d926b1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:03 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:03 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:03 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe" returned: 0 in 0.855s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.325s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:30:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073482022',display_name='tempest-VolumesGetTest-Volume-956769920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ab916a-cf5f-4de7-8faf-2816fe83b5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:30:57Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Creating volume 33ab916a-cf5f-4de7-8faf-2816fe83b5bb {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:03 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45890916-561f-4847-9aeb-f31b1af36ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11557a6-1281-406d-9823-a2e05c08db2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:03 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb 1073741824 Jul 05 17:31:03 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "cinder-d947037b-75f2-4d30-b836-8c1956fd4572-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:03 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Volume volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe (6ebd8efe-4f0e-476e-94b6-aea4de773ebe): created successfully Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11557a6-1281-406d-9823-a2e05c08db2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Flow 'volume_create_manager' (51648a4b-06b6-496a-98b9-3021099128b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-d947037b-75f2-4d30-b836-8c1956fd4572-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:03 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-bc694529-46f1-483f-a979-10aeced115e0 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Created volume successfully. Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "cinder-quobyte-d947037b-75f2-4d30-b836-8c1956fd4572" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-quobyte-d947037b-75f2-4d30-b836-8c1956fd4572" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd350a8-53b2-40e6-9e08-bb7a8b3ef8ed]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:04 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 Jul 05 17:31:04 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:04 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.746s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Deleted volume successfully. Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-179f6162-bad2-4891-84c1-47f133caa35e tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-8864d331-40a4-4a67-b5d0-ffb16b4180a9-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:04 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb 1073741824" returned: 0 in 1.029s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:04 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572" returned: 0 in 0.868s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:04 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb Jul 05 17:31:04 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:04 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572 Jul 05 17:31:04 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:05 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb" returned: 0 in 0.717s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.696s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Creating offline snapshot b16c600c-0cf0-4c7a-9271-273c52d533d1 of volume e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:31:05 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dc6911-e060-4e9a-af71-94aebe8a9f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8751d2-9035-46d7-ac47-a620eaeb1d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[feff500d-32a1-4ef2-8724-6174260fc6f2]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d947037b-75f2-4d30-b836-8c1956fd4572" returned: 0 in 0.770s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:05 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Volume volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb (33ab916a-cf5f-4de7-8faf-2816fe83b5bb): created successfully Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8751d2-9035-46d7-ac47-a620eaeb1d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (99f503cb-3907-41a8-b0bd-3f945fa404c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-quobyte-d947037b-75f2-4d30-b836-8c1956fd4572" released by "delete_volume" :: held 1.716s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5eb4cdb1-7cd9-48c5-936a-238da1987426 tempest-VolumesGetTest-59864492 None] Created volume successfully. Jul 05 17:31:05 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Created reservations ['0bd23fc7-5614-4237-a6fe-c381b57dcf44', '4d013720-77bc-4bc1-8c5d-be6df5444187', '6c754cf2-db86-4ac3-9876-aa0ecf82e037', 'd5d1a4f0-7c68-44c7-9764-f39ebc947540'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:05 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 Jul 05 17:31:05 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:06 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:06 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-33ab916a-cf5f-4de7-8faf-2816fe83b5bb-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Lock "cinder-33ab916a-cf5f-4de7-8faf-2816fe83b5bb-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-33ab916a-cf5f-4de7-8faf-2816fe83b5bb" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-33ab916a-cf5f-4de7-8faf-2816fe83b5bb" acquired by "delete_volume" :: waited 0.052s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7606a8a-7b9d-464d-baf8-989678a4bea2]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:06 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb Jul 05 17:31:06 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:07 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.132s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:07 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Deleted volume successfully. Jul 05 17:31:07 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" returned: 0 in 1.559s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fc96e5f6-952a-4118-a2a3-321a48510ac7 tempest-VolumesListAdminTestJSON-1918724121 None] Lock "cinder-d947037b-75f2-4d30-b836-8c1956fd4572-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:07 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 1G Jul 05 17:31:07 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:07 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb" returned: 0 in 1.170s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:07 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb Jul 05 17:31:07 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:08 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 1G" returned: 0 in 1.399s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:08 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 Jul 05 17:31:08 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:08 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-33ab916a-cf5f-4de7-8faf-2816fe83b5bb" returned: 0 in 0.986s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-33ab916a-cf5f-4de7-8faf-2816fe83b5bb" released by "delete_volume" :: held 2.237s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Created reservations ['f97b1029-6262-4020-917a-487b91fd5aa0', '959be7dd-0876-455f-90df-62bec41d9b2e', 'c1d81851-4e5f-4365-a6c6-5a900ac04145', 'dcff728e-a8e5-44b4-aa1e-95ff876a36ff'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:09 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:09 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:10 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1" returned: 0 in 1.353s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:10 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 is being set with open permissions: ugo+rw Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:10 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-3bd8d6ee-5689-4d4c-8174-e897723598e1-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:10 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Lock "cinder-3bd8d6ee-5689-4d4c-8174-e897723598e1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-3bd8d6ee-5689-4d4c-8174-e897723598e1" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-3bd8d6ee-5689-4d4c-8174-e897723598e1" acquired by "delete_volume" :: waited 0.061s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d267fb24-4b82-4b42-8db4-13cbd524f2a0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:10 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 Jul 05 17:31:10 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:10 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.488s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Deleted volume successfully. Jul 05 17:31:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5f83f8d7-709c-43f8-a7d6-9cbc595f2de4 tempest-VolumesGetTest-59864492 None] Lock "cinder-33ab916a-cf5f-4de7-8faf-2816fe83b5bb-delete_volume" released by "delete_volume" :: held 4.309s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:11 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1" returned: 0 in 1.136s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:11 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.info Jul 05 17:31:11 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:11 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1" returned: 0 in 1.292s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:11 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1 Jul 05 17:31:11 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:12 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.info" returned: 0 in 0.984s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:12 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.info is being set with open permissions: ugo+rw Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:12 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.info Jul 05 17:31:12 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:12 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3bd8d6ee-5689-4d4c-8174-e897723598e1" returned: 0 in 0.927s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-3bd8d6ee-5689-4d4c-8174-e897723598e1" released by "delete_volume" :: held 2.313s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Created reservations ['7d7ef2f6-af07-4176-83e1-81a6e883a8e2', 'a6c2897c-e447-44b2-92d6-dc8b526c6617', '28cd4694-6487-40b4-b1f2-f8d7738fd53f', '07145bad-c05d-4669-8be4-fa04cfe99780'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:12 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:12 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:13 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.info" returned: 0 in 0.836s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.414s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:13 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a4652ca9-a3df-4d8b-b9eb-346f49a1d38a tempest-VolumesSnapshotTestJSON-691700133 None] Create snapshot completed successfully Jul 05 17:31:13 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.725s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:13 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Deleted volume successfully. Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aff5efed-7b38-406b-8d7e-ca6d67ba47fe tempest-VolumesGetTest-59864492 None] Lock "cinder-3bd8d6ee-5689-4d4c-8174-e897723598e1-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-ed7f2871-60f5-44d1-be06-2927b297b97b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Lock "cinder-ed7f2871-60f5-44d1-be06-2927b297b97b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-ed7f2871-60f5-44d1-be06-2927b297b97b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-ed7f2871-60f5-44d1-be06-2927b297b97b" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cec70b-d837-4aaa-a349-6840a931067a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:14 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b Jul 05 17:31:14 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Flow 'volume_create_manager' (3736a86d-a232-46fd-8c60-08ac9614ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932760ce-309f-4790-8ead-8ece2fc65bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932760ce-309f-4790-8ead-8ece2fc65bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1097832957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8770017-32cf-4d83-ba0f-dde7645ee0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d82d9b54dd94ca68c4d0af1e415f6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:14Z,use_quota=True,user_id='2aadf47b86f34cea897894eec8436fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718b30ef-3510-4e11-a015-ea1b970367e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718b30ef-3510-4e11-a015-ea1b970367e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d32eb18-5633-441a-a240-78d88530f617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d32eb18-5633-441a-a240-78d88530f617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8770017-32cf-4d83-ba0f-dde7645ee0c8', 'volume_name': 'volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3af6fd-43bc-4eca-ab95-ae79d8033824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3af6fd-43bc-4eca-ab95-ae79d8033824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5722eacc-3640-4396-b1bb-b7b350174f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Volume f8770017-32cf-4d83-ba0f-dde7645ee0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8', 'volume_size': 1} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1097832957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8770017-32cf-4d83-ba0f-dde7645ee0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d82d9b54dd94ca68c4d0af1e415f6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:14Z,use_quota=True,user_id='2aadf47b86f34cea897894eec8436fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Creating volume f8770017-32cf-4d83-ba0f-dde7645ee0c8 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:14 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:14 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 1073741824 Jul 05 17:31:14 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (bb23e500-c237-471a-bdff-64d9fa495e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10db398-0b7e-4f13-b771-3eb48efcef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10db398-0b7e-4f13-b771-3eb48efcef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-901315115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf9be30-5a1f-4774-91e3-188f60ae33a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5e20b653bd41a8b5ef398cba6608d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b16c600c-0cf0-4c7a-9271-273c52d533d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:15Z,use_quota=True,user_id='0da692f4f5d548838d8972a29e146c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80dacf0-1381-47bd-b8f6-e27a282ec869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80dacf0-1381-47bd-b8f6-e27a282ec869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b2ab6a-da4a-426c-b2ca-dda09c70f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b2ab6a-da4a-426c-b2ca-dda09c70f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cf9be30-5a1f-4774-91e3-188f60ae33a6', 'volume_name': 'volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6', 'volume_size': 2, 'snapshot_id': 'b16c600c-0cf0-4c7a-9271-273c52d533d1'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178a0673-c3a9-4f08-a9aa-755c0d4ae38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178a0673-c3a9-4f08-a9aa-755c0d4ae38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524b8a0b-53ca-4882-8753-44a0f3babdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:14 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Volume 3cf9be30-5a1f-4774-91e3-188f60ae33a6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6', 'volume_size': 2, 'snapshot_id': 'b16c600c-0cf0-4c7a-9271-273c52d533d1'} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:14 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b" returned: 0 in 1.037s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:15 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b Jul 05 17:31:15 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:15 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 1073741824" returned: 0 in 0.932s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:15 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 Jul 05 17:31:15 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:15 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ed7f2871-60f5-44d1-be06-2927b297b97b" returned: 0 in 0.733s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-ed7f2871-60f5-44d1-be06-2927b297b97b" released by "delete_volume" :: held 1.859s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Created reservations ['31bb91c9-11a1-4475-9855-77cdca84b260', 'ed566c41-615c-4735-88dd-23c27a40461c', 'f43150e9-a84c-4290-8b4b-232aa5719c2b', 'e70e1b53-e160-4259-8c2a-fa8d36bdf930'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:15 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:15 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:16 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8" returned: 0 in 0.695s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.435s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-b16c600c-0cf0-4c7a-9271-273c52d533d1-3cf9be30-5a1f-4774-91e3-188f60ae33a6" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5722eacc-3640-4396-b1bb-b7b350174f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec52b7f4-db49-4f23-a027-d65f4b31da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-b16c600c-0cf0-4c7a-9271-273c52d533d1-3cf9be30-5a1f-4774-91e3-188f60ae33a6" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Creating volume 3cf9be30-5a1f-4774-91e3-188f60ae33a6 from snapshot b16c600c-0cf0-4c7a-9271-273c52d533d1 {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-3cf9be30-5a1f-4774-91e3-188f60ae33a6" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:16 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Volume volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 (f8770017-32cf-4d83-ba0f-dde7645ee0c8): created successfully Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec52b7f4-db49-4f23-a027-d65f4b31da55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Flow 'volume_create_manager' (3736a86d-a232-46fd-8c60-08ac9614ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ac379790-20b4-413d-b733-0d3740a30b82 tempest-AbsoluteLimitsTests-2124133344 None] Created volume successfully. Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-3cf9be30-5a1f-4774-91e3-188f60ae33a6" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] snapshot: b16c600c-0cf0-4c7a-9271-273c52d533d1, volume: 3cf9be30-5a1f-4774-91e3-188f60ae33a6, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e066f02e-b7a6-4109-8087-d0e16edf6816]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:16 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 Jul 05 17:31:16 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Acquiring lock "cinder-f8770017-32cf-4d83-ba0f-dde7645ee0c8-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Lock "cinder-f8770017-32cf-4d83-ba0f-dde7645ee0c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:16 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.916s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Deleted volume successfully. Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b0232f71-8988-4df9-94ea-807f76f4a554 tempest-VolumesGetTest-59864492 None] Lock "cinder-ed7f2871-60f5-44d1-be06-2927b297b97b-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Acquiring lock "cinder-quobyte-f8770017-32cf-4d83-ba0f-dde7645ee0c8" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Lock "cinder-quobyte-f8770017-32cf-4d83-ba0f-dde7645ee0c8" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f18d8f-b9d5-4c49-9557-2f6365f57a9a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:17 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 Jul 05 17:31:17 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:17 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1" returned: 0 in 1.038s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1d2c0a-7a0d-4e63-9fff-2cbd4abff813]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (81eea158-5067-4621-a5c1-0251c817d3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e281e6b-014b-4ab9-9f65-2005a94ac882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e281e6b-014b-4ab9-9f65-2005a94ac882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1188648838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac76fc7-2fed-4ccd-afaf-fef372581bbf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:17Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f29839-524d-4134-95e0-0abdc0ebd48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f29839-524d-4134-95e0-0abdc0ebd48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1856b1-069e-41c5-8ce8-937d91a84319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:17 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:31:17 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 Jul 05 17:31:17 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:17 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8" returned: 0 in 1.043s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:18 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8 Jul 05 17:31:18 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1856b1-069e-41c5-8ce8-937d91a84319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ac76fc7-2fed-4ccd-afaf-fef372581bbf', 'volume_name': 'volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0351730-8775-45a8-8acb-4081af7c6eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0351730-8775-45a8-8acb-4081af7c6eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025e1919-1f09-48d2-8065-8b897269e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:18 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Volume 4ac76fc7-2fed-4ccd-afaf-fef372581bbf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Trying to clone 4ac76fc7-2fed-4ccd-afaf-fef372581bbf from image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:31:18 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" returned: 0 in 1.021s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:18 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 Jul 05 17:31:18 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:31:18 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Image download 20.69 MB at 20.69 MB/s Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b62dcb4-3aba-471f-9bf6-e741d81d1d75]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:18 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f8770017-32cf-4d83-ba0f-dde7645ee0c8" returned: 0 in 0.762s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Lock "cinder-quobyte-f8770017-32cf-4d83-ba0f-dde7645ee0c8" released by "delete_volume" :: held 1.857s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Created reservations ['60bdd253-4b1f-4d2c-83a5-b272ecac56ef', '697b5094-c94f-429f-b698-d012dbb9a1cd', '25f34577-01e5-43ed-a211-d5f4acb0b390', '96650b02-0094-4d10-b47a-85788f0806c8'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:18 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD Jul 05 17:31:18 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:18 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:18 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:19 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD" returned: 0 in 0.996s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:19 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Temporary image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 is fetched for user 9e6f3f833fc34289922c554e8d4176bc. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:31:19 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96b3ad3-5e43-4c99-ac66-5a8292470cc7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:20 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.111s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:20 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Deleted volume successfully. Jul 05 17:31:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b6e306e6-e4bd-4f08-832e-32ca4b0d80b5 tempest-AbsoluteLimitsTests-2124133344 None] Lock "cinder-f8770017-32cf-4d83-ba0f-dde7645ee0c8-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:20 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD Jul 05 17:31:20 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:21 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD" returned: 0 in 1.274s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:24 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6" returned: 0 in 5.933s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:24 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cd7bb2-c0cb-4dd8-8606-84fe56bb297f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:24 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 Jul 05 17:31:24 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:25 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" returned: 0 in 1.000s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:25 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:31:25 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Converted 1024.00 MB image at 172.57 MB/s Jul 05 17:31:25 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 is being set with open permissions: ugo+rw Jul 05 17:31:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:25 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 Jul 05 17:31:25 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:26 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6" returned: 0 in 0.688s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-3cf9be30-5a1f-4774-91e3-188f60ae33a6" released by "_copy_volume_from_snapshot" :: held 9.845s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-b16c600c-0cf0-4c7a-9271-273c52d533d1-3cf9be30-5a1f-4774-91e3-188f60ae33a6" released by "_create_volume_from_snapshot" :: held 9.935s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.997s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.985s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1188648838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac76fc7-2fed-4ccd-afaf-fef372581bbf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:17Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Creating volume 4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:26 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:26 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf 1073741824 Jul 05 17:31:26 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524b8a0b-53ca-4882-8753-44a0f3babdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6', 'volume_size': 2, 'snapshot_id': 'b16c600c-0cf0-4c7a-9271-273c52d533d1'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb6543b-410b-4454-8fef-fbd65032dffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:26 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Volume volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 (3cf9be30-5a1f-4774-91e3-188f60ae33a6): created successfully Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb6543b-410b-4454-8fef-fbd65032dffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (bb23e500-c237-471a-bdff-64d9fa495e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:26 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-55efcb4b-5fd9-40fc-9491-c3702cf64a68 tempest-VolumesSnapshotTestJSON-691700133 None] Created volume successfully. Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-3cf9be30-5a1f-4774-91e3-188f60ae33a6-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-3cf9be30-5a1f-4774-91e3-188f60ae33a6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-3cf9be30-5a1f-4774-91e3-188f60ae33a6" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-3cf9be30-5a1f-4774-91e3-188f60ae33a6" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bea58de-3314-44c0-99cf-c846180bb600]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:27 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf 1073741824" returned: 0 in 0.891s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:27 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 Jul 05 17:31:27 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:27 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf Jul 05 17:31:27 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Flow 'volume_create_manager' (ebc06bc7-c327-4603-ae81-0ad626c93f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce610577-c858-4d68-ab74-4142a5225f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce610577-c858-4d68-ab74-4142a5225f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1322181656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba894bf5-e266-4c4f-ac18-e85143fc1e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff581a48c1ea48ea83e113a330a4d3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:28Z,use_quota=True,user_id='1a34f1011aad41f1809a03eabdc2692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:27 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98d5f93-edb4-4379-a413-57f615980246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98d5f93-edb4-4379-a413-57f615980246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3835bc-aa44-4945-8cbd-c50c1491943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3835bc-aa44-4945-8cbd-c50c1491943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba894bf5-e266-4c4f-ac18-e85143fc1e45', 'volume_name': 'volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309c3f41-1eb0-42f4-8b00-6daf22a94f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309c3f41-1eb0-42f4-8b00-6daf22a94f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2d142b-06ad-4bd6-bcfb-97cbf96361be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:27 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Volume ba894bf5-e266-4c4f-ac18-e85143fc1e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45', 'volume_size': 1} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" returned: 0 in 0.698s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1322181656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba894bf5-e266-4c4f-ac18-e85143fc1e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff581a48c1ea48ea83e113a330a4d3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:28Z,use_quota=True,user_id='1a34f1011aad41f1809a03eabdc2692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Creating volume ba894bf5-e266-4c4f-ac18-e85143fc1e45 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:27 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:27 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6" returned: 0 in 0.873s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:27 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 1073741824 Jul 05 17:31:27 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:27 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Attempting download of ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}])) to volume 4ac76fc7-2fed-4ccd-afaf-fef372581bbf. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:31:27 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6 Jul 05 17:31:27 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a9d040-d50c-440b-8218-fe7c6781ca60]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_lkw1imjz {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:28 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_lkw1imjz Jul 05 17:31:28 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:28 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3cf9be30-5a1f-4774-91e3-188f60ae33a6" returned: 0 in 0.708s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-3cf9be30-5a1f-4774-91e3-188f60ae33a6" released by "delete_volume" :: held 1.637s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Created reservations ['ea466d3a-3d36-477f-a07f-f0532cd03d0c', '9b00adab-fbdb-4187-90cb-1c70be566cd5', '21e8ead7-97b1-4828-bef9-334ed40a1479', '85893117-da10-4d63-b2a8-58356ef07b8a'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:28 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 1073741824" returned: 0 in 0.874s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:28 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_lkw1imjz" returned: 0 in 0.782s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_lkw1imjz {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:28 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:28 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:28 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 Jul 05 17:31:28 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:28 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_lkw1imjz Jul 05 17:31:28 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-b16c600c-0cf0-4c7a-9271-273c52d533d1-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-b16c600c-0cf0-4c7a-9271-273c52d533d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-b16c600c-0cf0-4c7a-9271-273c52d533d1" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-b16c600c-0cf0-4c7a-9271-273c52d533d1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Deleting offline snapshot b16c600c-0cf0-4c7a-9271-273c52d533d1 of volume e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] snapshot_file for this snap is: volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a7d31-7b33-420b-812a-fb0c4419dbbf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:29 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 Jul 05 17:31:29 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:29 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.742s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Deleted volume successfully. Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5859bd8e-6bae-4d57-a75c-ee85b9cf5db3 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-3cf9be30-5a1f-4774-91e3-188f60ae33a6-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:29 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45" returned: 0 in 0.807s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:29 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2d142b-06ad-4bd6-bcfb-97cbf96361be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9b9c3d-7c11-4124-bec7-bc014548513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_lkw1imjz" returned: 1 in 0.865s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_lkw1imjz' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3006a71d-620a-4cae-bf49-c24854cf35e5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:29 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Volume volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 (ba894bf5-e266-4c4f-ac18-e85143fc1e45): created successfully Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9b9c3d-7c11-4124-bec7-bc014548513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Flow 'volume_create_manager' (ebc06bc7-c327-4603-ae81-0ad626c93f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5962ca47-d7ea-49c4-aa12-2247c66b751d tempest-VolumesTransfersTest-1750529425 None] Created volume successfully. Jul 05 17:31:29 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD Jul 05 17:31:29 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:30 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1" returned: 0 in 0.890s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:31:30 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[31446e47-a103-4a05-a577-a6fa04b5f24d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:30 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 Jul 05 17:31:30 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:30 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e2a2efbc-47e7-4486-97dd-53c49ad54d59 tempest-VolumesTransfersTest-2074110216 None] Transfer volume completed successfully. Jul 05 17:31:30 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:30 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 was qcow2, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:31:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:30 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf Jul 05 17:31:30 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:31 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" returned: 0 in 0.841s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:31 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 Jul 05 17:31:31 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Acquiring lock "cinder-ba894bf5-e266-4c4f-ac18-e85143fc1e45-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Lock "cinder-ba894bf5-e266-4c4f-ac18-e85143fc1e45-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Acquiring lock "cinder-quobyte-ba894bf5-e266-4c4f-ac18-e85143fc1e45" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Lock "cinder-quobyte-ba894bf5-e266-4c4f-ac18-e85143fc1e45" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55f760-3902-4a5d-9dfd-07347d5f0150]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:31 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 Jul 05 17:31:31 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:32 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1" returned: 0 in 0.891s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:32 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1 Jul 05 17:31:32 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:32 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" returned: 0 in 2.009s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_y0xt6lwydevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:31:32 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Converted 112.00 MB image at 55.72 MB/s Jul 05 17:31:32 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45" returned: 0 in 0.972s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:32 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf 1G Jul 05 17:31:32 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:32 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45 Jul 05 17:31:32 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:32 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14.b16c600c-0cf0-4c7a-9271-273c52d533d1" returned: 0 in 0.700s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-b16c600c-0cf0-4c7a-9271-273c52d533d1" released by "_delete_snapshot" :: held 3.456s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" released by "delete_snapshot" :: held 3.480s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Created reservations ['b1a00c36-eb48-4ba2-8593-4ec9d8590ac1', '5ca3bf83-e5f9-48e4-bf93-cf36bb64b778', '164db573-3e8d-4372-ae59-c34137213a4a', 'b65519bb-495a-49ae-8aba-43719f24c220'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Delete snapshot completed successfully. Jul 05 17:31:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-70243377-4f01-4fa9-a90e-6017ecaadca8 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-b16c600c-0cf0-4c7a-9271-273c52d533d1-delete_snapshot" released by "delete_snapshot" :: held 3.682s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:33 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ba894bf5-e266-4c4f-ac18-e85143fc1e45" returned: 0 in 0.719s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:33 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Lock "cinder-quobyte-ba894bf5-e266-4c4f-ac18-e85143fc1e45" released by "delete_volume" :: held 1.762s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf 1G" returned: 0 in 0.757s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf509b3-e375-432e-a722-0d2b1d60e947]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Created reservations ['d3515c97-f4c2-4f02-8c4d-6e32bf22afe4', 'c56fbf56-5207-4814-8911-c5909ebdc80f', '435b3050-e0c5-400b-90d3-15ad4ac32ba8', '231f660a-e534-4a74-b94a-998ce4c2b498'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:33 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf Jul 05 17:31:33 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:33 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:33 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-e88167f5-c011-4c52-ac95-8e1a0c2f4f14-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-e88167f5-c011-4c52-ac95-8e1a0c2f4f14-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2786ed-8793-42dd-810f-ff34501aa869]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:33 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 Jul 05 17:31:33 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-e91fcd63-c523-4dc0-bac1-85c69d61f575 req-5dd2bd9e-c3eb-4697-a0eb-a26884ad6aaf tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-e91fcd63-c523-4dc0-bac1-85c69d61f575 req-5dd2bd9e-c3eb-4697-a0eb-a26884ad6aaf tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7879aa-d5e6-4747-abf0-553b5d262b7d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-e91fcd63-c523-4dc0-bac1-85c69d61f575 req-5dd2bd9e-c3eb-4697-a0eb-a26884ad6aaf tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:34 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.866s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Deleted volume successfully. Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-652bce39-a45c-43c2-8b52-6e0da3654507 tempest-VolumesTransfersTest-1858754089 None] Lock "cinder-ba894bf5-e266-4c4f-ac18-e85143fc1e45-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:34 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 Jul 05 17:31:34 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:31:34 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Flow 'volume_create_manager' (6a28a57e-f99c-4bb6-ac57-3cf346ea41d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d489147-635e-4f45-992c-62b29bb3933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" returned: 0 in 1.124s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d489147-635e-4f45-992c-62b29bb3933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1532104875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959fd27b-b8f8-48df-bdc2-afc6e09e3ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff581a48c1ea48ea83e113a330a4d3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:34Z,use_quota=True,user_id='1a34f1011aad41f1809a03eabdc2692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f036d679-3587-463a-9563-2eca21c6a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f036d679-3587-463a-9563-2eca21c6a749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae94dbf-075f-41cb-9a9a-2216583bf804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae94dbf-075f-41cb-9a9a-2216583bf804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959fd27b-b8f8-48df-bdc2-afc6e09e3ddd', 'volume_name': 'volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0f8b8-1056-4dc9-bbdb-21217bc76a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0f8b8-1056-4dc9-bbdb-21217bc76a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c256d3-5953-40af-a21a-6b5e8c23c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Volume 959fd27b-b8f8-48df-bdc2-afc6e09e3ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd', 'volume_size': 1} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:34 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf Jul 05 17:31:34 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:34 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" returned: 0 in 1.004s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:34 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14 Jul 05 17:31:34 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:35 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-e91fcd63-c523-4dc0-bac1-85c69d61f575 req-5dd2bd9e-c3eb-4697-a0eb-a26884ad6aaf tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5" returned: 0 in 0.870s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-e91fcd63-c523-4dc0-bac1-85c69d61f575 req-5dd2bd9e-c3eb-4697-a0eb-a26884ad6aaf tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.900s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1532104875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959fd27b-b8f8-48df-bdc2-afc6e09e3ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff581a48c1ea48ea83e113a330a4d3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:34Z,use_quota=True,user_id='1a34f1011aad41f1809a03eabdc2692b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Creating volume 959fd27b-b8f8-48df-bdc2-afc6e09e3ddd {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:35 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:35 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd 1073741824 Jul 05 17:31:35 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-e91fcd63-c523-4dc0-bac1-85c69d61f575 req-5dd2bd9e-c3eb-4697-a0eb-a26884ad6aaf tempest-TestServerVolumeAttachmentScenario-1772889548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '632937bc-e37b-47d1-bf6d-06628fea5c67', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:31:35 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-e91fcd63-c523-4dc0-bac1-85c69d61f575 req-5dd2bd9e-c3eb-4697-a0eb-a26884ad6aaf tempest-TestServerVolumeAttachmentScenario-1772889548 None] attachment_update completed successfully. Jul 05 17:31:35 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" returned: 1 in 0.804s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Downloaded image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}])) to volume 4ac76fc7-2fed-4ccd-afaf-fef372581bbf successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Temporary image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 for user 9e6f3f833fc34289922c554e8d4176bc is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Marking volume 4ac76fc7-2fed-4ccd-afaf-fef372581bbf as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Copying metadata from image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 to 4ac76fc7-2fed-4ccd-afaf-fef372581bbf. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Creating volume glance metadata for volume 4ac76fc7-2fed-4ccd-afaf-fef372581bbf backed by image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025e1919-1f09-48d2-8065-8b897269e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff8dbb5-ef73-42af-a9c1-7d07b046dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:35 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Volume volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf (4ac76fc7-2fed-4ccd-afaf-fef372581bbf): created successfully Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff8dbb5-ef73-42af-a9c1-7d07b046dd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (81eea158-5067-4621-a5c1-0251c817d3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:35 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4fd31ed6-46d2-4a2b-bc5c-250e80b9121a tempest-VolumesGetTest-59864492 None] Created volume successfully. Jul 05 17:31:35 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" returned: 0 in 0.710s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-e88167f5-c011-4c52-ac95-8e1a0c2f4f14" released by "delete_volume" :: held 1.817s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Created reservations ['0b9cbe25-60c7-425e-a0ea-11a2c8f88c38', 'fa7b2435-adaa-45c7-93a4-2fa5b6369a76', '10772906-f890-418e-af88-8e80dd1d5ac2', 'b43bf1cc-80ef-4dfd-b048-b76a40ca83dc'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:35 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:35 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:36 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd 1073741824" returned: 0 in 0.975s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:36 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd Jul 05 17:31:36 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:36 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.853s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Deleted volume successfully. Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5a9f022-aa19-4c32-8029-bda49d63dd96 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-e88167f5-c011-4c52-ac95-8e1a0c2f4f14-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (0bc3f7f6-2441-4ee8-8275-753377cfbe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe5552f-3c88-4eef-94e5-0162fc5f0734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe5552f-3c88-4eef-94e5-0162fc5f0734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1143214868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182ebb98-a6d8-4a5a-b99b-84075c94a8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5e20b653bd41a8b5ef398cba6608d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:37Z,use_quota=True,user_id='0da692f4f5d548838d8972a29e146c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030c3176-74bd-4df4-b4ad-42893789b622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030c3176-74bd-4df4-b4ad-42893789b622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c25ac0-a6a3-474d-96c8-45aa4af9df23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c25ac0-a6a3-474d-96c8-45aa4af9df23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182ebb98-a6d8-4a5a-b99b-84075c94a8d8', 'volume_name': 'volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89b7682-561c-4b66-8412-3fd4025f6586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89b7682-561c-4b66-8412-3fd4025f6586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd431b7-c3a7-4fe0-8e1d-a7577ef89d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:36 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Volume 182ebb98-a6d8-4a5a-b99b-84075c94a8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8', 'volume_size': 1} Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:36 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd" returned: 0 in 0.849s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.272s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1143214868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182ebb98-a6d8-4a5a-b99b-84075c94a8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5e20b653bd41a8b5ef398cba6608d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:37Z,use_quota=True,user_id='0da692f4f5d548838d8972a29e146c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Creating volume 182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:37 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c256d3-5953-40af-a21a-6b5e8c23c076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d369c49b-44e6-4224-a83f-9f35785731a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:37 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 1073741824 Jul 05 17:31:37 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:37 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Volume volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd (959fd27b-b8f8-48df-bdc2-afc6e09e3ddd): created successfully Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d369c49b-44e6-4224-a83f-9f35785731a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Flow 'volume_create_manager' (6a28a57e-f99c-4bb6-ac57-3cf346ea41d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (23a636ae-1da1-43b0-a773-fdd49bb6a4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a25a205-64e6-43f2-8fa5-3e284d0745d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-900cd570-f7e1-40b2-bf59-7498bd9f4675 tempest-VolumesTransfersTest-1750529425 None] Created volume successfully. Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=117,cinder:UPDATE=143,cinder:INSERT=42,cinder:DELETE=14 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a25a205-64e6-43f2-8fa5-3e284d0745d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2080040184',display_name='tempest-VolumesGetTest-Volume-1487735668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bda8679-3b33-4978-9487-2828ec496958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:37Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b12a90-89c0-44d8-a72a-465937619453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b12a90-89c0-44d8-a72a-465937619453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2dbfa80-09e4-47f4-bf2f-3501bbe64091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2dbfa80-09e4-47f4-bf2f-3501bbe64091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bda8679-3b33-4978-9487-2828ec496958', 'volume_name': 'volume-8bda8679-3b33-4978-9487-2828ec496958', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3772e8-9f11-4368-9fef-ae6800e3dc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3772e8-9f11-4368-9fef-ae6800e3dc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7124333a-9438-455f-af88-2bfaf003d165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:37 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Volume 8bda8679-3b33-4978-9487-2828ec496958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bda8679-3b33-4978-9487-2828ec496958', 'volume_size': 1} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Acquiring lock "cinder-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Lock "cinder-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:37 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 1073741824" returned: 0 in 0.884s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Acquiring lock "cinder-quobyte-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Lock "cinder-quobyte-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[2046c7c1-20e1-4a61-b966-57aca3af5ec5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:37 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 Jul 05 17:31:37 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:38 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd Jul 05 17:31:38 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:38 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" returned: 0 in 0.665s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2080040184',display_name='tempest-VolumesGetTest-Volume-1487735668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bda8679-3b33-4978-9487-2828ec496958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b389e513d964fc29a63ea69205692a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:37Z,use_quota=True,user_id='9e6f3f833fc34289922c554e8d4176bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Creating volume 8bda8679-3b33-4978-9487-2828ec496958 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:38 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd431b7-c3a7-4fe0-8e1d-a7577ef89d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:38 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 1073741824 Jul 05 17:31:38 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f362ff-6bc1-4a78-b8d2-7db0984175e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:38 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Volume volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 (182ebb98-a6d8-4a5a-b99b-84075c94a8d8): created successfully Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f362ff-6bc1-4a78-b8d2-7db0984175e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (0bc3f7f6-2441-4ee8-8275-753377cfbe19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-07719023-a4eb-41bf-a15a-28e4e9460d7c tempest-VolumesSnapshotTestJSON-691700133 None] Created volume successfully. Jul 05 17:31:38 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd" returned: 0 in 0.795s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:38 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd Jul 05 17:31:38 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:39 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd" returned: 0 in 0.680s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Lock "cinder-quobyte-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd" released by "delete_volume" :: held 1.523s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:39 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 1073741824" returned: 0 in 0.856s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Created reservations ['8bfeba72-731e-4d59-9764-3da3b74a4383', '46aae259-5876-4f0e-ab52-df41f3228d31', 'ce417340-61ec-4650-8b71-1025232e8268', '7de6f1fa-dbf5-4ac8-957c-314928f25ec1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:39 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 Jul 05 17:31:39 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:39 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:39 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:40 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958" returned: 0 in 0.778s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.485s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:40 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7124333a-9438-455f-af88-2bfaf003d165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bda8679-3b33-4978-9487-2828ec496958', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718eb9e7-8d0a-4c93-b6ff-e86aa3aca854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Creating offline snapshot 8718b50f-7a48-454c-ba28-56274e8f9da7 of volume 182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.743s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Deleted volume successfully. Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e295d13a-8a3b-4071-9edc-ff74687eac75]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Volume volume-8bda8679-3b33-4978-9487-2828ec496958 (8bda8679-3b33-4978-9487-2828ec496958): created successfully Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718eb9e7-8d0a-4c93-b6ff-e86aa3aca854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Flow 'volume_create_manager' (23a636ae-1da1-43b0-a773-fdd49bb6a4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5c04fa98-f694-451a-93d1-a89f81f25ee7 tempest-VolumesTransfersTest-1858754089 None] Lock "cinder-959fd27b-b8f8-48df-bdc2-afc6e09e3ddd-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d25e7e58-9cc3-45cc-b033-be2b08a74f72 tempest-VolumesGetTest-59864492 None] Created volume successfully. Jul 05 17:31:40 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 Jul 05 17:31:40 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:41 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" returned: 0 in 0.876s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:41 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 1G Jul 05 17:31:41 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-8bda8679-3b33-4978-9487-2828ec496958-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Lock "cinder-8bda8679-3b33-4978-9487-2828ec496958-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-8bda8679-3b33-4978-9487-2828ec496958" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-8bda8679-3b33-4978-9487-2828ec496958" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6176547b-0c73-4ae5-b30f-f7f0a299fa85]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:41 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 Jul 05 17:31:41 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:42 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 1G" returned: 0 in 1.112s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:42 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 Jul 05 17:31:42 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:42 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958" returned: 0 in 0.984s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:42 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958 Jul 05 17:31:42 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:43 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7" returned: 0 in 0.913s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:43 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 is being set with open permissions: ugo+rw Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:43 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 Jul 05 17:31:43 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:43 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8bda8679-3b33-4978-9487-2828ec496958" returned: 0 in 0.933s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-8bda8679-3b33-4978-9487-2828ec496958" released by "delete_volume" :: held 1.986s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Created reservations ['28e925a8-fe6b-459a-b41a-830b1002ef9c', '135896e9-c70c-4d9a-b8ac-d1ca0032c023', '9a79c483-f330-41ea-b9a7-aea20cd8f508', '0b00f45b-153a-48fa-88f5-d088c75c9bc9'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:43 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:43 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:44 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-4ac76fc7-2fed-4ccd-afaf-fef372581bbf-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7" returned: 0 in 0.964s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Lock "cinder-4ac76fc7-2fed-4ccd-afaf-fef372581bbf-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Acquiring lock "cinder-quobyte-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:44 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.info Jul 05 17:31:44 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c80fc-35d3-4b54-b154-526fe606a54b]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:44 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf Jul 05 17:31:44 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:44 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.963s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Deleted volume successfully. Jul 05 17:31:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d8bb01c2-60c8-4c5a-98d6-9353bb06cafc tempest-VolumesGetTest-59864492 None] Lock "cinder-8bda8679-3b33-4978-9487-2828ec496958-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:45 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.info" returned: 0 in 0.852s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:45 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.info is being set with open permissions: ugo+rw Jul 05 17:31:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:45 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.info Jul 05 17:31:45 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:45 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" returned: 0 in 0.930s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:45 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf Jul 05 17:31:45 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:45 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.info" returned: 0 in 0.725s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.641s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2c9f2116-2fe6-46d4-948b-b07beaeea23e tempest-VolumesSnapshotTestJSON-691700133 None] Create snapshot completed successfully Jul 05 17:31:46 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" returned: 1 in 0.997s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:31:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:46 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf Jul 05 17:31:46 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (5d6942b1-2d02-4bce-bf04-7916ba63c019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757771fa-862c-463e-9ac4-3370bfdb4321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757771fa-862c-463e-9ac4-3370bfdb4321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-674029910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d267daa-3f06-4d16-b3ce-df410fbfb758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5e20b653bd41a8b5ef398cba6608d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8718b50f-7a48-454c-ba28-56274e8f9da7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:31:47Z,use_quota=True,user_id='0da692f4f5d548838d8972a29e146c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661a6827-bfde-480f-a9ff-088f45864ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661a6827-bfde-480f-a9ff-088f45864ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8beebe82-ac98-4837-82d3-cacea5aba085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8beebe82-ac98-4837-82d3-cacea5aba085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6d267daa-3f06-4d16-b3ce-df410fbfb758', 'volume_name': 'volume-6d267daa-3f06-4d16-b3ce-df410fbfb758', 'volume_size': 1, 'snapshot_id': '8718b50f-7a48-454c-ba28-56274e8f9da7'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d02c28-3b87-4f2f-98e6-d5cf3603cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d02c28-3b87-4f2f-98e6-d5cf3603cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ddd92d-3e96-46b5-8295-96fb1862b092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:47 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Volume 6d267daa-3f06-4d16-b3ce-df410fbfb758: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6d267daa-3f06-4d16-b3ce-df410fbfb758', 'volume_size': 1, 'snapshot_id': '8718b50f-7a48-454c-ba28-56274e8f9da7'} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-8718b50f-7a48-454c-ba28-56274e8f9da7-6d267daa-3f06-4d16-b3ce-df410fbfb758" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-8718b50f-7a48-454c-ba28-56274e8f9da7-6d267daa-3f06-4d16-b3ce-df410fbfb758" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Creating volume 6d267daa-3f06-4d16-b3ce-df410fbfb758 from snapshot 8718b50f-7a48-454c-ba28-56274e8f9da7 {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-6d267daa-3f06-4d16-b3ce-df410fbfb758" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-6d267daa-3f06-4d16-b3ce-df410fbfb758" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] snapshot: 8718b50f-7a48-454c-ba28-56274e8f9da7, volume: 6d267daa-3f06-4d16-b3ce-df410fbfb758, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bf5a1b-9b67-457a-88f9-8122be2fefb3]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:47 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" returned: 0 in 0.982s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Lock "cinder-quobyte-4ac76fc7-2fed-4ccd-afaf-fef372581bbf" released by "delete_volume" :: held 3.011s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:47 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 Jul 05 17:31:47 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Created reservations ['3317fbbe-e23e-4654-a594-5705c869db17', '42f5892b-07c9-4e97-b22f-756f48f5dfcf', 'de0296e9-0cef-4457-9923-8b7ad7eb4c05', '3949fbe7-fd2c-4ce5-8415-05bf63d7045d'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:47 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:47 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-95984460-2c0a-4396-8803-1e99c6bc39ad req-c497c9f8-0018-4ce7-972c-bac784601857 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:48 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7" returned: 0 in 0.970s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6181d535-357e-4976-aba5-b581d365f29f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:48 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 Jul 05 17:31:48 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:48 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.855s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Deleted volume successfully. Jul 05 17:31:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d573e0f1-495d-48e0-9ac7-778702cb8454 tempest-VolumesGetTest-59864492 None] Lock "cinder-4ac76fc7-2fed-4ccd-afaf-fef372581bbf-delete_volume" released by "delete_volume" :: held 4.187s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:49 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" returned: 0 in 0.937s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:49 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:31:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:49 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 Jul 05 17:31:49 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:31:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:31:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:31:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:31:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:50 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:31:50 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:52 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.379s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:52 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:31:52 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:31:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:31:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:31:55 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758" returned: 0 in 6.123s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:55 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1ad8db-44be-4ecd-bd78-59e31772ecd9]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:55 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 Jul 05 17:31:55 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:56 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" returned: 0 in 1.211s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:56 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:31:56 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Converted 1024.00 MB image at 167.22 MB/s Jul 05 17:31:56 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 is being set with open permissions: ugo+rw Jul 05 17:31:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:56 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 Jul 05 17:31:56 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:57 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758" returned: 0 in 0.845s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-6d267daa-3f06-4d16-b3ce-df410fbfb758" released by "_copy_volume_from_snapshot" :: held 10.214s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-8718b50f-7a48-454c-ba28-56274e8f9da7-6d267daa-3f06-4d16-b3ce-df410fbfb758" released by "_create_volume_from_snapshot" :: held 10.257s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.275s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-95984460-2c0a-4396-8803-1e99c6bc39ad req-c497c9f8-0018-4ce7-972c-bac784601857 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.752s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d15297-8088-4183-a71d-327aa8e6d89e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-95984460-2c0a-4396-8803-1e99c6bc39ad req-c497c9f8-0018-4ce7-972c-bac784601857 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ddd92d-3e96-46b5-8295-96fb1862b092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d267daa-3f06-4d16-b3ce-df410fbfb758', 'volume_size': 1, 'snapshot_id': '8718b50f-7a48-454c-ba28-56274e8f9da7'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3761538a-1531-4a31-8a86-ca8bb36fdfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:31:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Volume volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 (6d267daa-3f06-4d16-b3ce-df410fbfb758): created successfully Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3761538a-1531-4a31-8a86-ca8bb36fdfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:31:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Flow 'volume_create_manager' (5d6942b1-2d02-4bce-bf04-7916ba63c019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:31:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4bddb135-3cad-468d-bc6b-3c7e93461b62 tempest-VolumesSnapshotTestJSON-691700133 None] Created volume successfully. Jul 05 17:31:57 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe Jul 05 17:31:57 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:58 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-95984460-2c0a-4396-8803-1e99c6bc39ad req-c497c9f8-0018-4ce7-972c-bac784601857 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe" returned: 0 in 1.004s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-95984460-2c0a-4396-8803-1e99c6bc39ad req-c497c9f8-0018-4ce7-972c-bac784601857 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.030s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-95984460-2c0a-4396-8803-1e99c6bc39ad req-c497c9f8-0018-4ce7-972c-bac784601857 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93f16110-b23b-41b7-aa27-231b6f0c4b0f', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:31:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-95984460-2c0a-4396-8803-1e99c6bc39ad req-c497c9f8-0018-4ce7-972c-bac784601857 tempest-TestServerVolumeAttachmentScenario-1772889548 None] attachment_update completed successfully. Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-6d267daa-3f06-4d16-b3ce-df410fbfb758-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-6d267daa-3f06-4d16-b3ce-df410fbfb758-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-6d267daa-3f06-4d16-b3ce-df410fbfb758" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-6d267daa-3f06-4d16-b3ce-df410fbfb758" acquired by "delete_volume" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[acccda9c-cfc7-48e6-b9b2-c0f06206e0e6]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:31:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:59 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 Jul 05 17:31:59 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:31:59 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 05 17:31:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758" returned: 0 in 0.951s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:31:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:31:59 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758 Jul 05 17:31:59 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:00 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6d267daa-3f06-4d16-b3ce-df410fbfb758" returned: 0 in 0.735s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-6d267daa-3f06-4d16-b3ce-df410fbfb758" released by "delete_volume" :: held 1.742s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=116,cinder:INSERT=38,cinder:UPDATE=151,cinder:DELETE=14 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Created reservations ['faaf0919-1a31-4369-aa70-6fe82e83eccf', '54aea746-1813-4a55-8434-f982596394fd', '2c5652d9-604c-40b2-a5d3-121691e6d150', '9616bd30-173c-4b3b-9ce7-651ca56edd54'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:00 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:32:00 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-8718b50f-7a48-454c-ba28-56274e8f9da7-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-8718b50f-7a48-454c-ba28-56274e8f9da7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-8718b50f-7a48-454c-ba28-56274e8f9da7" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-8718b50f-7a48-454c-ba28-56274e8f9da7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Deleting offline snapshot 8718b50f-7a48-454c-ba28-56274e8f9da7 of volume 182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] snapshot_file for this snap is: volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[83447db7-b4ae-41fb-bdff-4a9e020ef162]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:01 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 Jul 05 17:32:01 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:01 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.979s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:32:01 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Deleted volume successfully. Jul 05 17:32:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1f938edb-513f-4019-8dd2-71997de13e2e tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-6d267daa-3f06-4d16-b3ce-df410fbfb758-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:02 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7" returned: 0 in 0.929s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:32:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[24168d34-5453-4bdd-9ff2-df9527345a52]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:02 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 Jul 05 17:32:02 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:03 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" returned: 0 in 1.155s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:03 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 Jul 05 17:32:03 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:04 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7" returned: 0 in 0.910s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:04 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7 Jul 05 17:32:04 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-a1ed93be-f56c-4440-b57a-61c10e04237f req-324de16a-0443-41be-b2fa-a7b4f6ae046e tempest-TestServerVolumeAttachmentScenario-1772889548 None] Terminate volume connection completed successfully. Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-a1ed93be-f56c-4440-b57a-61c10e04237f req-324de16a-0443-41be-b2fa-a7b4f6ae046e tempest-TestServerVolumeAttachmentScenario-1772889548 None] Deleting attachment 93f16110-b23b-41b7-aa27-231b6f0c4b0f. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:32:05 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8.8718b50f-7a48-454c-ba28-56274e8f9da7" returned: 0 in 0.885s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-8718b50f-7a48-454c-ba28-56274e8f9da7" released by "_delete_snapshot" :: held 4.070s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" released by "delete_snapshot" :: held 4.112s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Created reservations ['96647de3-8690-4cad-adb4-6456b3906ad9', '7d900f07-a064-4412-a719-649b397b37b8', '76c21546-85a3-4b7e-a1c5-ddbd1e69b6a7', 'df125ee0-12f3-427d-b86e-9fe4357abedf'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:32:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Delete snapshot completed successfully. Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15f37da4-8281-4d30-b4f4-5fdfea90e8ae tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-8718b50f-7a48-454c-ba28-56274e8f9da7-delete_snapshot" released by "delete_snapshot" :: held 4.300s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-182ebb98-a6d8-4a5a-b99b-84075c94a8d8-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-182ebb98-a6d8-4a5a-b99b-84075c94a8d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cdd372-3467-4b58-8ed0-43ef1cc310df]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:05 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 Jul 05 17:32:05 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:06 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" returned: 0 in 0.979s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:06 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8 Jul 05 17:32:06 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:07 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" returned: 0 in 0.813s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-182ebb98-a6d8-4a5a-b99b-84075c94a8d8" released by "delete_volume" :: held 1.896s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Created reservations ['3419d363-7fde-4819-8562-1c47b1245ea5', '9f3d6981-36ba-4c05-8912-e4ad57c738be', 'cdcecd5f-7a35-419a-a07c-f0f25cb6fa16', 'f0481914-c74a-4bdf-b95c-31a37916bf80'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:07 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:32:07 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-ff5c0b6b-f869-4b35-ab65-08234647535e-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-ff5c0b6b-f869-4b35-ab65-08234647535e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "cinder-quobyte-ff5c0b6b-f869-4b35-ab65-08234647535e" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-ff5c0b6b-f869-4b35-ab65-08234647535e" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e22e51-a79a-4204-bdf0-0bdcf7408a2d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:08 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e Jul 05 17:32:08 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:08 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.793s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:32:08 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Deleted volume successfully. Jul 05 17:32:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b8896c45-100b-49f2-9863-23f4971a2822 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-182ebb98-a6d8-4a5a-b99b-84075c94a8d8-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-11c7a7b8-a991-4634-9d4f-fd2bd4376c1c req-4b6cca4b-358a-483d-9c50-76ae33e9a951 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Terminate volume connection completed successfully. Jul 05 17:32:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-11c7a7b8-a991-4634-9d4f-fd2bd4376c1c req-4b6cca4b-358a-483d-9c50-76ae33e9a951 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Deleting attachment 632937bc-e37b-47d1-bf6d-06628fea5c67. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:32:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e" returned: 0 in 1.202s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:09 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:09 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e Jul 05 17:32:09 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:10 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ff5c0b6b-f869-4b35-ab65-08234647535e" returned: 0 in 0.764s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-quobyte-ff5c0b6b-f869-4b35-ab65-08234647535e" released by "delete_volume" :: held 2.059s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Created reservations ['eac9f708-110f-48c9-bfa5-3086a66a9670', '758de8a8-ba4b-4d91-9f86-f77d5646792d', '30711535-b006-4368-9bf4-74cf07a73e19', 'deea7d21-b790-4649-a7bb-6a708786ba90'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:10 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:32:10 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:11 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.987s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:11 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:32:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Deleted volume successfully. Jul 05 17:32:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d8991ed-9b6a-4e04-8e31-83669fb37952 tempest-VolumesSnapshotTestJSON-691700133 None] Lock "cinder-ff5c0b6b-f869-4b35-ab65-08234647535e-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:20 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=65,cinder:SELECT=54,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:32:21 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:INSERT=9,cinder:UPDATE=31,cinder:SELECT=18,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:32:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "cinder-6ebd8efe-4f0e-476e-94b6-aea4de773ebe-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "cinder-6ebd8efe-4f0e-476e-94b6-aea4de773ebe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "cinder-quobyte-6ebd8efe-4f0e-476e-94b6-aea4de773ebe" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "cinder-quobyte-6ebd8efe-4f0e-476e-94b6-aea4de773ebe" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:23 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce91301d-763b-48bb-bb9d-451df56c0896]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:23 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe Jul 05 17:32:23 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:24 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe" returned: 0 in 1.048s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:24 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe Jul 05 17:32:24 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:24 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6ebd8efe-4f0e-476e-94b6-aea4de773ebe" returned: 0 in 0.845s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "cinder-quobyte-6ebd8efe-4f0e-476e-94b6-aea4de773ebe" released by "delete_volume" :: held 1.963s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Created reservations ['ea67a127-7b27-46e9-ae31-7ce3f3c1db18', '0e0cc9cb-e6f9-4844-a649-f639d118ba96', '58550b0a-cf14-4db0-992c-57b7bba93813', 'cd7d9c32-da17-4608-9249-654ef9a4d557'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "cinder-5a99ec33-c1ee-4ab7-9755-11b1656cfab5-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:25 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:32:25 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "cinder-5a99ec33-c1ee-4ab7-9755-11b1656cfab5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "cinder-quobyte-5a99ec33-c1ee-4ab7-9755-11b1656cfab5" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "cinder-quobyte-5a99ec33-c1ee-4ab7-9755-11b1656cfab5" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822379c-ad6e-4b95-bcf9-01b212531086]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:25 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 Jul 05 17:32:25 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Flow 'volume_create_manager' (6728027e-c532-4c9e-ad0c-4b321841db1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:26 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305d5734-fa47-49cd-87a5-44d45b6227f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.110s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:32:26 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Deleted volume successfully. Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305d5734-fa47-49cd-87a5-44d45b6227f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaace586-408a-4aee-8e30-d85ebb46ca34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14adda64ad3840a2b46fdfa791d27e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:26Z,use_quota=True,user_id='41e0641861584e2aa1dcc17b2e79f23b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9865a026-837d-4d59-a7f2-a79b2214de2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9865a026-837d-4d59-a7f2-a79b2214de2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ed5bd8-f7d5-4c41-b855-c3e974208c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-aa1328fe-5b5f-40d6-a656-f3b592d60d19 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "cinder-6ebd8efe-4f0e-476e-94b6-aea4de773ebe-delete_volume" released by "delete_volume" :: held 3.499s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:26 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5" returned: 0 in 1.183s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:26 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5 Jul 05 17:32:26 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ed5bd8-f7d5-4c41-b855-c3e974208c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eaace586-408a-4aee-8e30-d85ebb46ca34', 'volume_name': 'volume-eaace586-408a-4aee-8e30-d85ebb46ca34', 'volume_size': 1, 'image_id': '441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f5953a597ba5233f97f45fc7452d507', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14adda64ad3840a2b46fdfa791d27e92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd169d8f49fe094707fe76c793d7514026565a3a1184dd60894424ca527a34fbff735d3c06bede0e0b948af909e4784e0142977263725af82879219dfd0d7d856', 'id': '441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7/file', 'properties': {}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8db03e-daf1-441b-a3eb-1532212392b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8db03e-daf1-441b-a3eb-1532212392b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e831331d-14e7-4277-8c33-2f4357b5acea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:26 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Volume eaace586-408a-4aee-8e30-d85ebb46ca34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eaace586-408a-4aee-8e30-d85ebb46ca34', 'volume_size': 1, 'image_id': '441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f5953a597ba5233f97f45fc7452d507', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14adda64ad3840a2b46fdfa791d27e92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd169d8f49fe094707fe76c793d7514026565a3a1184dd60894424ca527a34fbff735d3c06bede0e0b948af909e4784e0142977263725af82879219dfd0d7d856', 'id': '441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7/file', 'properties': {}}, 'image_service': } Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Trying to clone eaace586-408a-4aee-8e30-d85ebb46ca34 from image 441e8d29-b52a-4aa6-bce0-c1c6df0638a7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:32:26 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:32:26 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Image download 0.00 MB at 0.00 MB/s Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3dbc37-da90-4db0-8cfc-9c6dc1ee8396]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:27 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD Jul 05 17:32:27 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:27 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5a99ec33-c1ee-4ab7-9755-11b1656cfab5" returned: 0 in 0.950s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "cinder-quobyte-5a99ec33-c1ee-4ab7-9755-11b1656cfab5" released by "delete_volume" :: held 2.197s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Created reservations ['14d9959f-ad42-41e9-a245-de663da9affd', '885cd8c9-e45a-48ac-b59c-220f71d65094', 'b2f31597-dc04-4e89-ac7a-ca53754eb2d7', '23468924-d265-4a8d-bb7b-2b60ff6a0ca1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:27 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:32:27 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:28 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD" returned: 0 in 1.153s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:28 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD Jul 05 17:32:28 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:28 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.887s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:28 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:32:28 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Deleted volume successfully. Jul 05 17:32:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d66624da-cf85-427f-915d-8d0a05f3bf96 tempest-TestServerVolumeAttachmentScenario-1772889548 None] Lock "cinder-5a99ec33-c1ee-4ab7-9755-11b1656cfab5-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:29 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD" returned: 1 in 0.932s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:29 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Temporary image 441e8d29-b52a-4aa6-bce0-c1c6df0638a7 is fetched for user 41e0641861584e2aa1dcc17b2e79f23b. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:32:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710e29c-c762-43e9-a095-671a617a1ec8]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:29 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD Jul 05 17:32:29 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:30 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD" returned: 0 in 0.995s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:30 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD Jul 05 17:32:30 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:31 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD" returned: 1 in 1.072s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaace586-408a-4aee-8e30-d85ebb46ca34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14adda64ad3840a2b46fdfa791d27e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:26Z,use_quota=True,user_id='41e0641861584e2aa1dcc17b2e79f23b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Creating volume eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:32:31 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:32:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:31 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 1073741824 Jul 05 17:32:31 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:32 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 1073741824" returned: 0 in 1.114s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:32 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 Jul 05 17:32:32 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:33 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34" returned: 0 in 0.891s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:32:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:33 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Attempting download of 441e8d29-b52a-4aa6-bce0-c1c6df0638a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'metadata': {}}])) to volume eaace586-408a-4aee-8e30-d85ebb46ca34. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:32:33 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5a26b6-975f-4b69-b455-8e5949e95882]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_c29qct6f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:33 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_c29qct6f Jul 05 17:32:33 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Flow 'volume_create_manager' (80bb91a8-09bf-4589-ae42-3ee094c5d950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27446b28-82d7-486d-b437-5852eb64a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27446b28-82d7-486d-b437-5852eb64a401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1604381254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6f917f-295a-46af-8d2c-c18c152b9986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a04925aaa2c4bf392d06d9cce024b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:34Z,use_quota=True,user_id='d10bf5bbe1f44bfbb0006da26eb86436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12be7f00-af26-4182-b539-3a45488b3b2f),volume_type_id=12be7f00-af26-4182-b539-3a45488b3b2f)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b8174d-f709-434b-8344-5da257ebbc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b8174d-f709-434b-8344-5da257ebbc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433cb83f-37d3-41c9-9fff-2a53f5cd9b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433cb83f-37d3-41c9-9fff-2a53f5cd9b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6f917f-295a-46af-8d2c-c18c152b9986', 'volume_name': 'volume-da6f917f-295a-46af-8d2c-c18c152b9986', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f2272a-528a-43ef-8466-783d44fef6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f2272a-528a-43ef-8466-783d44fef6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b03f8f-15c1-4248-b922-488e564fc27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Volume da6f917f-295a-46af-8d2c-c18c152b9986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6f917f-295a-46af-8d2c-c18c152b9986', 'volume_size': 1} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1604381254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6f917f-295a-46af-8d2c-c18c152b9986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a04925aaa2c4bf392d06d9cce024b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:34Z,use_quota=True,user_id='d10bf5bbe1f44bfbb0006da26eb86436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12be7f00-af26-4182-b539-3a45488b3b2f),volume_type_id=12be7f00-af26-4182-b539-3a45488b3b2f)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Creating volume da6f917f-295a-46af-8d2c-c18c152b9986 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:32:34 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:34 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 1073741824 Jul 05 17:32:34 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Flow 'volume_create_manager' (2ddd4112-93fb-46b5-bc98-dda9123a17b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c1df31-271e-4811-8dfc-20c9e43ad406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c1df31-271e-4811-8dfc-20c9e43ad406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1636920196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e9d416-dac4-431f-b685-0c125e440120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a04925aaa2c4bf392d06d9cce024b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:35Z,use_quota=True,user_id='d10bf5bbe1f44bfbb0006da26eb86436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fc0fd0e-fc9d-4c4a-8406-b1125886ee70),volume_type_id=9fc0fd0e-fc9d-4c4a-8406-b1125886ee70)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34359722-0745-43f9-9600-319007c23c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34359722-0745-43f9-9600-319007c23c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c8f73e-8c0b-40e4-b6a7-dc9224709dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c8f73e-8c0b-40e4-b6a7-dc9224709dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e9d416-dac4-431f-b685-0c125e440120', 'volume_name': 'volume-81e9d416-dac4-431f-b685-0c125e440120', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:34 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f8e769-2b11-4d54-a704-c024148479c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f8e769-2b11-4d54-a704-c024148479c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514df7ae-c0f9-488e-9890-6ac5c37cf61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Volume 81e9d416-dac4-431f-b685-0c125e440120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e9d416-dac4-431f-b685-0c125e440120', 'volume_size': 1} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_c29qct6f" returned: 0 in 1.280s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_c29qct6f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:34 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_c29qct6f Jul 05 17:32:34 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Flow 'volume_create_manager' (3c50a6b4-9a59-44f3-8bad-c73aad859363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9395f8c0-0f15-4890-b15f-6db9e03d96b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9395f8c0-0f15-4890-b15f-6db9e03d96b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-55132201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3987091-00d8-4d74-9b35-952f0dc028db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a04925aaa2c4bf392d06d9cce024b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:35Z,use_quota=True,user_id='d10bf5bbe1f44bfbb0006da26eb86436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b26889d-b7fc-4804-839f-1681c86b01e6),volume_type_id=7b26889d-b7fc-4804-839f-1681c86b01e6)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:35 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c21f8f4-388a-408c-bd6a-81f815d0aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c21f8f4-388a-408c-bd6a-81f815d0aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04eddf0b-bea4-420e-b6b7-dac176f1ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 1073741824" returned: 0 in 1.270s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:35 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 Jul 05 17:32:35 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:35 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_c29qct6f" returned: 1 in 0.986s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_c29qct6f' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d9c1b0-bb8e-46e6-9343-333e969bb361]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:36 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD Jul 05 17:32:36 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04eddf0b-bea4-420e-b6b7-dac176f1ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3987091-00d8-4d74-9b35-952f0dc028db', 'volume_name': 'volume-f3987091-00d8-4d74-9b35-952f0dc028db', 'volume_size': 1, 'image_id': '86659660-e54a-4cac-be48-312b7d8c6943', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86659660-e54a-4cac-be48-312b7d8c6943', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--344313367', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a04925aaa2c4bf392d06d9cce024b18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86659660-e54a-4cac-be48-312b7d8c6943', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86659660-e54a-4cac-be48-312b7d8c6943/file', 'properties': {}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c8908a-0cc2-43ab-83fd-6d8156f65689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c8908a-0cc2-43ab-83fd-6d8156f65689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bda8de-71a1-45c6-bf71-6bdbf24f471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:36 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Volume f3987091-00d8-4d74-9b35-952f0dc028db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3987091-00d8-4d74-9b35-952f0dc028db', 'volume_size': 1, 'image_id': '86659660-e54a-4cac-be48-312b7d8c6943', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86659660-e54a-4cac-be48-312b7d8c6943', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--344313367', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a04925aaa2c4bf392d06d9cce024b18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86659660-e54a-4cac-be48-312b7d8c6943', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86659660-e54a-4cac-be48-312b7d8c6943/file', 'properties': {}}, 'image_service': } Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Trying to clone f3987091-00d8-4d74-9b35-952f0dc028db from image 86659660-e54a-4cac-be48-312b7d8c6943 at location (None, [{'url': 'file:///opt/stack/data/glance/images/86659660-e54a-4cac-be48-312b7d8c6943', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:32:36 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986" returned: 0 in 1.318s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] <== create_volume: return (2641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.643s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1636920196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e9d416-dac4-431f-b685-0c125e440120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a04925aaa2c4bf392d06d9cce024b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:35Z,use_quota=True,user_id='d10bf5bbe1f44bfbb0006da26eb86436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fc0fd0e-fc9d-4c4a-8406-b1125886ee70),volume_type_id=9fc0fd0e-fc9d-4c4a-8406-b1125886ee70)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Creating volume 81e9d416-dac4-431f-b685-0c125e440120 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:32:36 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:32:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:36 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 1073741824 Jul 05 17:32:36 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b03f8f-15c1-4248-b922-488e564fc27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6f917f-295a-46af-8d2c-c18c152b9986', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e2d1e7-754c-48ec-bb20-13289dd45bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:37 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD" returned: 0 in 1.248s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:37 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Volume volume-da6f917f-295a-46af-8d2c-c18c152b9986 (da6f917f-295a-46af-8d2c-c18c152b9986): created successfully Jul 05 17:32:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e2d1e7-754c-48ec-bb20-13289dd45bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Flow 'volume_create_manager' (80bb91a8-09bf-4589-ae42-3ee094c5d950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9a97bf29-2ee2-45bb-a0d5-0a7f52cc59f3 tempest-TestInstancesWithCinderVolumes-1460434 None] Created volume successfully. Jul 05 17:32:37 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD Jul 05 17:32:37 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:38 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD" returned: 1 in 1.137s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:38 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] 441e8d29-b52a-4aa6-bce0-c1c6df0638a7 was raw, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:32:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:38 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 Jul 05 17:32:38 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:38 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 1073741824" returned: 0 in 1.659s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:38 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 Jul 05 17:32:38 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:39 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120" returned: 0 in 1.113s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] <== create_volume: return (2858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.864s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514df7ae-c0f9-488e-9890-6ac5c37cf61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e9d416-dac4-431f-b685-0c125e440120', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47e69fc-39ec-44be-9d1d-bd6502ef5637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:39 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Volume volume-81e9d416-dac4-431f-b685-0c125e440120 (81e9d416-dac4-431f-b685-0c125e440120): created successfully Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47e69fc-39ec-44be-9d1d-bd6502ef5637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:39 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Flow 'volume_create_manager' (2ddd4112-93fb-46b5-bc98-dda9123a17b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34" returned: 0 in 1.698s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_441e8d29-b52a-4aa6-bce0-c1c6df0638a7_cugd3od5devstack@QuobyteHD, size 0.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:32:39 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 17:32:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:39 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-48199c79-47be-4ba1-a3fa-7438a83155bf tempest-TestInstancesWithCinderVolumes-1460434 None] Created volume successfully. Jul 05 17:32:39 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 1G Jul 05 17:32:39 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:40 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 1G" returned: 0 in 1.103s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[02030c03-2a24-4eab-834e-e6c165a6ab4b]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:41 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 Jul 05 17:32:41 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:42 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34" returned: 0 in 1.236s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:42 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 Jul 05 17:32:42 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:42 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD, size 20.69 MB, duration 6.76 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:32:42 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Image download 20.69 MB at 3.06 MB/s Jul 05 17:32:42 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0274988-52fe-431d-a0bc-ad032e0dfaee]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:43 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD Jul 05 17:32:43 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:43 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34" returned: 1 in 1.304s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Downloaded image 441e8d29-b52a-4aa6-bce0-c1c6df0638a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'metadata': {}}])) to volume eaace586-408a-4aee-8e30-d85ebb46ca34 successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Temporary image 441e8d29-b52a-4aa6-bce0-c1c6df0638a7 for user 41e0641861584e2aa1dcc17b2e79f23b is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Marking volume eaace586-408a-4aee-8e30-d85ebb46ca34 as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Copying metadata from image 441e8d29-b52a-4aa6-bce0-c1c6df0638a7 to eaace586-408a-4aee-8e30-d85ebb46ca34. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Creating volume glance metadata for volume eaace586-408a-4aee-8e30-d85ebb46ca34 backed by image 441e8d29-b52a-4aa6-bce0-c1c6df0638a7 with: {'image_id': '441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8f5953a597ba5233f97f45fc7452d507', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e831331d-14e7-4277-8c33-2f4357b5acea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaace586-408a-4aee-8e30-d85ebb46ca34', 'volume_size': 1, 'image_id': '441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f5953a597ba5233f97f45fc7452d507', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14adda64ad3840a2b46fdfa791d27e92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd169d8f49fe094707fe76c793d7514026565a3a1184dd60894424ca527a34fbff735d3c06bede0e0b948af909e4784e0142977263725af82879219dfd0d7d856', 'id': '441e8d29-b52a-4aa6-bce0-c1c6df0638a7', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/441e8d29-b52a-4aa6-bce0-c1c6df0638a7/file', 'properties': {}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338eb9fc-ee7d-48a6-b23c-da44bda3d811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:43 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Volume volume-eaace586-408a-4aee-8e30-d85ebb46ca34 (eaace586-408a-4aee-8e30-d85ebb46ca34): created successfully Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338eb9fc-ee7d-48a6-b23c-da44bda3d811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Flow 'volume_create_manager' (6728027e-c532-4c9e-ad0c-4b321841db1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:43 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d4859fa4-9570-4b8e-aed1-4d98959e1283 tempest-VolumeImageDependencyTests-1097331852 None] Created volume successfully. Jul 05 17:32:44 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD" returned: 0 in 1.232s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Temporary image 86659660-e54a-4cac-be48-312b7d8c6943 is fetched for user d10bf5bbe1f44bfbb0006da26eb86436. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Acquiring lock "cinder-eaace586-408a-4aee-8e30-d85ebb46ca34-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Lock "cinder-eaace586-408a-4aee-8e30-d85ebb46ca34-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Acquiring lock "cinder-quobyte-eaace586-408a-4aee-8e30-d85ebb46ca34" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b49a0a6-49ca-4a02-bebb-68fccca4f7d3]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Lock "cinder-quobyte-eaace586-408a-4aee-8e30-d85ebb46ca34" acquired by "delete_volume" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[93240898-86f2-474e-a667-bd2b4365da51]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:44 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD Jul 05 17:32:44 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:44 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 Jul 05 17:32:44 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:45 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD" returned: 0 in 1.392s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-55132201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3987091-00d8-4d74-9b35-952f0dc028db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a04925aaa2c4bf392d06d9cce024b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:35Z,use_quota=True,user_id='d10bf5bbe1f44bfbb0006da26eb86436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b26889d-b7fc-4804-839f-1681c86b01e6),volume_type_id=7b26889d-b7fc-4804-839f-1681c86b01e6)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Creating volume f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:32:45 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:45 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db 1073741824 Jul 05 17:32:45 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:45 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34" returned: 0 in 1.390s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:46 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 Jul 05 17:32:46 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:46 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34" returned: 1 in 1.008s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:46 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34 Jul 05 17:32:46 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:46 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db 1073741824" returned: 0 in 1.154s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:47 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:32:47 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:47 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eaace586-408a-4aee-8e30-d85ebb46ca34" returned: 0 in 0.993s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Lock "cinder-quobyte-eaace586-408a-4aee-8e30-d85ebb46ca34" released by "delete_volume" :: held 3.496s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:47 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Created reservations ['0b8e9252-588b-4ba9-a8d8-2e127a44f6d0', 'e3e323f4-b8a1-429f-83ce-359c931090e9', '5c624444-ef03-463b-bbc4-975ebab578f8', 'd7e36101-aef8-41c5-bde5-4f2fbf37bc13'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:48 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:32:48 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:48 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 0 in 1.131s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.371s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Attempting download of 86659660-e54a-4cac-be48-312b7d8c6943 ((None, [{'url': 'file:///opt/stack/data/glance/images/86659660-e54a-4cac-be48-312b7d8c6943', 'metadata': {}}])) to volume f3987091-00d8-4d74-9b35-952f0dc028db. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6e7a15-6157-4a27-92a9-5bef152b1b90]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86659660-e54a-4cac-be48-312b7d8c6943_mw88ic27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:48 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86659660-e54a-4cac-be48-312b7d8c6943_mw88ic27 Jul 05 17:32:48 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:48 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.701s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:32:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Deleted volume successfully. Jul 05 17:32:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cdd40706-4faa-4542-adf4-9d8befe2145b tempest-VolumeImageDependencyTests-1097331852 None] Lock "cinder-eaace586-408a-4aee-8e30-d85ebb46ca34-delete_volume" released by "delete_volume" :: held 4.543s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:32:49 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86659660-e54a-4cac-be48-312b7d8c6943_mw88ic27" returned: 0 in 0.909s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86659660-e54a-4cac-be48-312b7d8c6943_mw88ic27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:49 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86659660-e54a-4cac-be48-312b7d8c6943_mw88ic27 Jul 05 17:32:49 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:50 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86659660-e54a-4cac-be48-312b7d8c6943_mw88ic27" returned: 1 in 0.941s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86659660-e54a-4cac-be48-312b7d8c6943_mw88ic27' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf695214-b3dc-4108-96d2-18a6770780a5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:50 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD Jul 05 17:32:50 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:50 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:32:50 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:51 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD" returned: 0 in 1.197s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] 86659660-e54a-4cac-be48-312b7d8c6943 was qcow2, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:51 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:32:51 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Flow 'volume_create_manager' (639405e0-3661-4ea2-a48a-f6fe1986644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d010e518-42e2-41a4-9db5-ee7e8d3f1881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d010e518-42e2-41a4-9db5-ee7e8d3f1881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d82cee0-f3ec-4c35-b3bb-6d96874aef7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ab9fb711c34d08825df1812a804423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:52Z,use_quota=True,user_id='caf6c3494bed40378f35bf007e0bcae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00b246d7-a523-40ed-bf5f-8899fd3549ac),volume_type_id=00b246d7-a523-40ed-bf5f-8899fd3549ac)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a17926-2b79-4868-aae2-7c95e076ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a17926-2b79-4868-aae2-7c95e076ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22318e6b-6e9f-4aaa-bc26-2cb2169aee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:32:51 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.138s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:32:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:32:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22318e6b-6e9f-4aaa-bc26-2cb2169aee07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d82cee0-f3ec-4c35-b3bb-6d96874aef7f', 'volume_name': 'volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f', 'volume_size': 1, 'image_id': '87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf2d226d95a471fd5f0ca231b43d19d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45ab9fb711c34d08825df1812a804423', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f3b388c96a3235750c2a18ce0fee7005606c0dc95f092a3da0e261818531056d31d4a291ea0ef69b1158bf5d6535f929f80594710b41c3582467c5c3765000b', 'id': '87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f98b7c0-4989-426f-b4ed-a98d8b67c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f98b7c0-4989-426f-b4ed-a98d8b67c99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3898dd-28e3-4987-b8ae-a22c0a85d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:52 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Volume 7d82cee0-f3ec-4c35-b3bb-6d96874aef7f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f', 'volume_size': 1, 'image_id': '87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf2d226d95a471fd5f0ca231b43d19d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45ab9fb711c34d08825df1812a804423', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f3b388c96a3235750c2a18ce0fee7005606c0dc95f092a3da0e261818531056d31d4a291ea0ef69b1158bf5d6535f929f80594710b41c3582467c5c3765000b', 'id': '87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 17:32:52 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Trying to clone 7d82cee0-f3ec-4c35-b3bb-6d96874aef7f from image 87f55d97-5c12-4a8a-9bce-050fc616b4b8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:32:52 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:32:52 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Image download 0.00 MB at 0.00 MB/s Jul 05 17:32:52 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f597b225-6df9-4e60-97dd-2e00b6225469]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:52 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD Jul 05 17:32:52 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Flow 'volume_create_manager' (f05e8a30-51d9-46b7-9ed3-ca24dcad910b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dcb23c-3ce0-4f76-9d32-d14cb52d812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dcb23c-3ce0-4f76-9d32-d14cb52d812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fec5ab3-d476-4998-99d2-d47f92e17a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091151eb1a0841f9a22bb7c7bf2cc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:53Z,use_quota=True,user_id='5cddd129066e471ab841459463e70b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369d3a72-910c-4d86-9690-fc6dec4a1f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369d3a72-910c-4d86-9690-fc6dec4a1f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ad1ac7-258e-4308-adda-04b9881bbcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ad1ac7-258e-4308-adda-04b9881bbcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fec5ab3-d476-4998-99d2-d47f92e17a2a', 'volume_name': 'volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd84993-20f7-4b1f-bb91-718d0440db2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd84993-20f7-4b1f-bb91-718d0440db2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7537fede-d218-4fcd-aaed-1eda621dcd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:53 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Volume 5fec5ab3-d476-4998-99d2-d47f92e17a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a', 'volume_size': 1} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fec5ab3-d476-4998-99d2-d47f92e17a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091151eb1a0841f9a22bb7c7bf2cc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:53Z,use_quota=True,user_id='5cddd129066e471ab841459463e70b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Creating volume 5fec5ab3-d476-4998-99d2-d47f92e17a2a {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:32:53 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:53 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:53 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a 1073741824 Jul 05 17:32:53 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:53 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD Jul 05 17:32:53 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:53 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 0 in 2.381s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86659660-e54a-4cac-be48-312b7d8c6943_59umlv7jdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:32:53 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Converted 112.00 MB image at 47.00 MB/s Jul 05 17:32:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:53 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db 1G Jul 05 17:32:53 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:54 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD" returned: 1 in 0.767s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Temporary image 87f55d97-5c12-4a8a-9bce-050fc616b4b8 is fetched for user caf6c3494bed40378f35bf007e0bcae2. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:32:54 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a 1073741824" returned: 0 in 0.869s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5fd17-2cc1-4398-99ae-4a34ec82180f]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:54 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a Jul 05 17:32:54 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:54 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db 1G" returned: 0 in 0.735s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:54 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD Jul 05 17:32:54 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e7c62-4153-47b7-9eb1-a145bc25057b]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:54 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:32:54 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:54 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a" returned: 0 in 0.654s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:32:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7537fede-d218-4fcd-aaed-1eda621dcd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc33cef9-2c0f-449e-bff7-c7208682bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:55 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Volume volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a (5fec5ab3-d476-4998-99d2-d47f92e17a2a): created successfully Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc33cef9-2c0f-449e-bff7-c7208682bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:55 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Flow 'volume_create_manager' (f05e8a30-51d9-46b7-9ed3-ca24dcad910b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-321b1644-18c3-4327-931d-d60f3e975d01 tempest-CinderUnicodeTest-2139879188 None] Created volume successfully. Jul 05 17:32:55 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD Jul 05 17:32:55 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:55 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 0 in 0.750s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:55 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:32:55 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:55 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD" returned: 1 in 0.755s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d82cee0-f3ec-4c35-b3bb-6d96874aef7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ab9fb711c34d08825df1812a804423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:52Z,use_quota=True,user_id='caf6c3494bed40378f35bf007e0bcae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00b246d7-a523-40ed-bf5f-8899fd3549ac),volume_type_id=00b246d7-a523-40ed-bf5f-8899fd3549ac)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Creating volume 7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:32:55 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:55 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f 1073741824 Jul 05 17:32:55 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Flow 'volume_create_manager' (1f718542-4fde-42b2-8868-ebcfa705bf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29aa1d40-ecac-4b48-9738-4d7d84285ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29aa1d40-ecac-4b48-9738-4d7d84285ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1876707183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7eb34d8-529a-4a50-bccf-64852fc590a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091151eb1a0841f9a22bb7c7bf2cc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:56Z,use_quota=True,user_id='5cddd129066e471ab841459463e70b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffcc25a-5198-4ef4-a538-4329a3902eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:56 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffcc25a-5198-4ef4-a538-4329a3902eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a675319-2d43-4244-b13e-84b8c9363af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a675319-2d43-4244-b13e-84b8c9363af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7eb34d8-529a-4a50-bccf-64852fc590a3', 'volume_name': 'volume-f7eb34d8-529a-4a50-bccf-64852fc590a3', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f286104-c91d-43ba-be71-6f0484343df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f286104-c91d-43ba-be71-6f0484343df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b7eb7c-e3b5-4729-a4d6-04eaaa00e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:56 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Volume f7eb34d8-529a-4a50-bccf-64852fc590a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7eb34d8-529a-4a50-bccf-64852fc590a3', 'volume_size': 1} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 1 in 0.826s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Downloaded image 86659660-e54a-4cac-be48-312b7d8c6943 ((None, [{'url': 'file:///opt/stack/data/glance/images/86659660-e54a-4cac-be48-312b7d8c6943', 'metadata': {}}])) to volume f3987091-00d8-4d74-9b35-952f0dc028db successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Temporary image 86659660-e54a-4cac-be48-312b7d8c6943 for user d10bf5bbe1f44bfbb0006da26eb86436 is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Marking volume f3987091-00d8-4d74-9b35-952f0dc028db as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Copying metadata from image 86659660-e54a-4cac-be48-312b7d8c6943 to f3987091-00d8-4d74-9b35-952f0dc028db. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Creating volume glance metadata for volume f3987091-00d8-4d74-9b35-952f0dc028db backed by image 86659660-e54a-4cac-be48-312b7d8c6943 with: {'image_id': '86659660-e54a-4cac-be48-312b7d8c6943', 'image_name': 'tempest-scenario-img--344313367', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bda8de-71a1-45c6-bf71-6bdbf24f471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3987091-00d8-4d74-9b35-952f0dc028db', 'volume_size': 1, 'image_id': '86659660-e54a-4cac-be48-312b7d8c6943', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86659660-e54a-4cac-be48-312b7d8c6943', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--344313367', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a04925aaa2c4bf392d06d9cce024b18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86659660-e54a-4cac-be48-312b7d8c6943', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86659660-e54a-4cac-be48-312b7d8c6943/file', 'properties': {}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffaec68b-f7f7-4e19-bb74-f0bbc5fee1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:56 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Volume volume-f3987091-00d8-4d74-9b35-952f0dc028db (f3987091-00d8-4d74-9b35-952f0dc028db): created successfully Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffaec68b-f7f7-4e19-bb74-f0bbc5fee1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Flow 'volume_create_manager' (3c50a6b4-9a59-44f3-8bad-c73aad859363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:56 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3d242526-a756-48b0-b92c-e94c1eee6126 tempest-TestInstancesWithCinderVolumes-1460434 None] Created volume successfully. Jul 05 17:32:56 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f 1073741824" returned: 0 in 0.885s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:56 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f Jul 05 17:32:56 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:57 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" returned: 0 in 0.677s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:32:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1876707183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7eb34d8-529a-4a50-bccf-64852fc590a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091151eb1a0841f9a22bb7c7bf2cc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:32:56Z,use_quota=True,user_id='5cddd129066e471ab841459463e70b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Creating volume f7eb34d8-529a-4a50-bccf-64852fc590a3 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:32:57 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:57 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 1073741824 Jul 05 17:32:57 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Attempting download of 87f55d97-5c12-4a8a-9bce-050fc616b4b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'metadata': {}}])) to volume 7d82cee0-f3ec-4c35-b3bb-6d96874aef7f. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b28aea4-78f0-4f04-9830-88080b4b37de]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87f55d97-5c12-4a8a-9bce-050fc616b4b8_2uvlxdb_ {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:57 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87f55d97-5c12-4a8a-9bce-050fc616b4b8_2uvlxdb_ Jul 05 17:32:57 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:58 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87f55d97-5c12-4a8a-9bce-050fc616b4b8_2uvlxdb_" returned: 0 in 0.865s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87f55d97-5c12-4a8a-9bce-050fc616b4b8_2uvlxdb_ {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:58 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 1073741824" returned: 0 in 1.042s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:58 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87f55d97-5c12-4a8a-9bce-050fc616b4b8_2uvlxdb_ Jul 05 17:32:58 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:58 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 Jul 05 17:32:58 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:32:59 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87f55d97-5c12-4a8a-9bce-050fc616b4b8_2uvlxdb_" returned: 1 in 0.796s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87f55d97-5c12-4a8a-9bce-050fc616b4b8_2uvlxdb_' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2cdbd7-0056-4a08-b482-b385626c8e4a]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:32:59 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b7eb7c-e3b5-4729-a4d6-04eaaa00e49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7eb34d8-529a-4a50-bccf-64852fc590a3', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d71a62-f28c-495b-8dbe-c3c1b553dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:32:59 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Volume volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 (f7eb34d8-529a-4a50-bccf-64852fc590a3): created successfully Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d71a62-f28c-495b-8dbe-c3c1b553dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:32:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Flow 'volume_create_manager' (1f718542-4fde-42b2-8868-ebcfa705bf11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:32:59 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0c339549-b662-4fe5-8cf5-e0ad3580143d tempest-CinderUnicodeTest-2139879188 None] Created volume successfully. Jul 05 17:32:59 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD Jul 05 17:32:59 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:00 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:00 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD Jul 05 17:33:00 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Creating offline snapshot 162fc042-e46d-4651-8355-05f4e239e785 of volume f7eb34d8-529a-4a50-bccf-64852fc590a3 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51aad14-2e45-45f4-9ac9-ab9124bbfd1d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:00 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 Jul 05 17:33:00 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:00 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD" returned: 1 in 0.816s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] 87f55d97-5c12-4a8a-9bce-050fc616b4b8 was raw, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:33:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:00 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f Jul 05 17:33:00 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:01 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3" returned: 0 in 0.828s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:01 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 1G Jul 05 17:33:01 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:01 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" returned: 0 in 0.803s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:01 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_87f55d97-5c12-4a8a-9bce-050fc616b4b8_1ol3ns5rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:33:01 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 17:33:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:01 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f 1G Jul 05 17:33:01 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:02 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 1G" returned: 0 in 0.823s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:02 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 Jul 05 17:33:02 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:02 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f 1G" returned: 0 in 0.740s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[13707502-bf53-4362-b648-0cf22a734015]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:02 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f Jul 05 17:33:02 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:02 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785" returned: 0 in 0.861s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:02 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 is being set with open permissions: ugo+rw Jul 05 17:33:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:02 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 Jul 05 17:33:02 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:03 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" returned: 0 in 0.996s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:03 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f Jul 05 17:33:03 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:03 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785" returned: 0 in 0.975s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:04 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.info Jul 05 17:33:04 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:04 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" returned: 1 in 0.945s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Downloaded image 87f55d97-5c12-4a8a-9bce-050fc616b4b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'metadata': {}}])) to volume 7d82cee0-f3ec-4c35-b3bb-6d96874aef7f successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Temporary image 87f55d97-5c12-4a8a-9bce-050fc616b4b8 for user caf6c3494bed40378f35bf007e0bcae2 is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Marking volume 7d82cee0-f3ec-4c35-b3bb-6d96874aef7f as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Copying metadata from image 87f55d97-5c12-4a8a-9bce-050fc616b4b8 to 7d82cee0-f3ec-4c35-b3bb-6d96874aef7f. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Creating volume glance metadata for volume 7d82cee0-f3ec-4c35-b3bb-6d96874aef7f backed by image 87f55d97-5c12-4a8a-9bce-050fc616b4b8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bf2d226d95a471fd5f0ca231b43d19d5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3898dd-28e3-4987-b8ae-a22c0a85d031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f', 'volume_size': 1, 'image_id': '87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf2d226d95a471fd5f0ca231b43d19d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45ab9fb711c34d08825df1812a804423', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f3b388c96a3235750c2a18ce0fee7005606c0dc95f092a3da0e261818531056d31d4a291ea0ef69b1158bf5d6535f929f80594710b41c3582467c5c3765000b', 'id': '87f55d97-5c12-4a8a-9bce-050fc616b4b8', 'created_at': datetime.datetime(2026, 7, 5, 15, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 32, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87f55d97-5c12-4a8a-9bce-050fc616b4b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a54b250-f7a5-4c64-ac3f-5652d6e0402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:04 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Volume volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f (7d82cee0-f3ec-4c35-b3bb-6d96874aef7f): created successfully Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a54b250-f7a5-4c64-ac3f-5652d6e0402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Flow 'volume_create_manager' (639405e0-3661-4ea2-a48a-f6fe1986644b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-23a9d507-e2b3-4061-a8bb-3eba27b51e1a tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Created volume successfully. Jul 05 17:33:04 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.info" returned: 0 in 0.815s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:04 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.info is being set with open permissions: ugo+rw Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Acquiring lock "cinder-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:04 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.info Jul 05 17:33:04 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Flow 'volume_create_manager' (fb1fe692-d633-4014-893f-2b78789aa930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ee358b-3564-4dcc-bfb7-43cacc3a0310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "cinder-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ee358b-3564-4dcc-bfb7-43cacc3a0310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1665100485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d9003c-fc7b-421c-aa97-881da4fb4f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4eff982fe9c4a969a53710d6e13726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:05Z,use_quota=True,user_id='e4f52be901444386b277da25765978cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d2f0b0-e03d-4c23-96f3-077d8e3dd314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d2f0b0-e03d-4c23-96f3-077d8e3dd314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d788f4-4f80-456b-b185-fe664a7d97ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d788f4-4f80-456b-b185-fe664a7d97ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d9003c-fc7b-421c-aa97-881da4fb4f87', 'volume_name': 'volume-42d9003c-fc7b-421c-aa97-881da4fb4f87', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2aa708f-fffe-4c5d-93f2-b50c79a8a549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2aa708f-fffe-4c5d-93f2-b50c79a8a549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac40619-0049-4240-9dbd-d40cdbe4c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:04 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Volume 42d9003c-fc7b-421c-aa97-881da4fb4f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d9003c-fc7b-421c-aa97-881da4fb4f87', 'volume_size': 1} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Acquiring lock "cinder-quobyte-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "cinder-quobyte-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503b6de-7bdf-4f8f-9e7d-bfa52668bd06]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:05 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f Jul 05 17:33:05 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:05 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.info" returned: 0 in 0.723s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.165s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.565s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f105ceff-38e3-49e9-ab5e-2a8390cfeb8f tempest-CinderUnicodeTest-2139879188 None] Create snapshot completed successfully Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9c2866-36d1-40e1-8349-402f23c45695]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:05 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:33:05 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "cinder-162fc042-e46d-4651-8355-05f4e239e785-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-162fc042-e46d-4651-8355-05f4e239e785-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "cinder-quobyte-f7eb34d8-529a-4a50-bccf-64852fc590a3" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-quobyte-f7eb34d8-529a-4a50-bccf-64852fc590a3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "cinder-quobyte-162fc042-e46d-4651-8355-05f4e239e785" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-quobyte-162fc042-e46d-4651-8355-05f4e239e785" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Deleting offline snapshot 162fc042-e46d-4651-8355-05f4e239e785 of volume f7eb34d8-529a-4a50-bccf-64852fc590a3 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] snapshot_file for this snap is: volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:33:05 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" returned: 0 in 0.834s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[95134ac9-f2a3-4ce8-ab63-a20a55ffe6bf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:06 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f Jul 05 17:33:06 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:06 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 Jul 05 17:33:06 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:06 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 0 in 0.926s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:06 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:33:06 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:06 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" returned: 1 in 0.842s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:06 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f Jul 05 17:33:06 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:06 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785" returned: 0 in 0.877s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7eb34d8-529a-4a50-bccf-64852fc590a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fc5f25-ace0-4fe5-89c9-bec6fe32f3bd]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:06 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 Jul 05 17:33:06 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:07 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 1 in 0.864s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.845s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.430s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1665100485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d9003c-fc7b-421c-aa97-881da4fb4f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4eff982fe9c4a969a53710d6e13726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:05Z,use_quota=True,user_id='e4f52be901444386b277da25765978cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Creating volume 42d9003c-fc7b-421c-aa97-881da4fb4f87 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:07 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:07 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" returned: 0 in 0.684s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:07 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 1073741824 Jul 05 17:33:07 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "cinder-quobyte-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f" released by "delete_volume" :: held 2.450s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-f3987091-00d8-4d74-9b35-952f0dc028db', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a1363a8-c596-42f1-97f8-04e7d3de824b', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:33:07 devstack cinder-volume[86459]: WARNING cinder.quota [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:33:07 devstack cinder-volume[86459]: WARNING cinder.quota [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Created reservations ['443edd75-1a51-4549-83de-64b73ff2612e', 'c7ab9519-cf28-4fc9-8cf0-d328089492b2', '15d9c3a6-dcad-4ebc-aaad-676db267cf8a', '6cbaf346-4829-46f4-ade8-158e063eb16b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-8a4a95dc-41c8-4f63-80f3-55e1f0899d4f req-1d9f9ed8-cf5e-435c-b348-46d2a6495125 tempest-TestInstancesWithCinderVolumes-1460434 None] attachment_update completed successfully. Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:07 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3" returned: 0 in 0.842s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:07 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:07 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:07 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 Jul 05 17:33:07 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:08 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.778s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:08 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:08 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Deleted volume successfully. Jul 05 17:33:08 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 1073741824" returned: 0 in 1.046s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6367386-a1f4-42b9-8734-224e9f99f3ae tempest-VolumeAndVolumeTypeFromImageTest-1906170490 None] Lock "cinder-7d82cee0-f3ec-4c35-b3bb-6d96874aef7f-delete_volume" released by "delete_volume" :: held 3.576s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:08 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 Jul 05 17:33:08 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:08 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785" returned: 0 in 0.938s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:08 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785 Jul 05 17:33:08 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:09 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87" returned: 0 in 0.778s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac40619-0049-4240-9dbd-d40cdbe4c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d9003c-fc7b-421c-aa97-881da4fb4f87', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a30dd9c-bc92-4f24-98f7-80e66be87df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:09 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Volume volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 (42d9003c-fc7b-421c-aa97-881da4fb4f87): created successfully Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a30dd9c-bc92-4f24-98f7-80e66be87df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Flow 'volume_create_manager' (fb1fe692-d633-4014-893f-2b78789aa930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-24ce1020-cac4-4a6c-b260-78dd075a78e3 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Created volume successfully. Jul 05 17:33:09 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3.162fc042-e46d-4651-8355-05f4e239e785" returned: 0 in 0.810s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-quobyte-162fc042-e46d-4651-8355-05f4e239e785" released by "_delete_snapshot" :: held 3.609s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-quobyte-f7eb34d8-529a-4a50-bccf-64852fc590a3" released by "delete_snapshot" :: held 3.634s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Created reservations ['a4fc2d8b-48bd-46c5-99e4-14c8d7a68c05', '56cb206e-e1f3-46e8-9d11-6511cfc2f253', '9fdb3adc-6494-4f32-978b-7350cd3ad20d', '225d2a58-ae2b-48d8-8610-06fe56c82f00'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Delete snapshot completed successfully. Jul 05 17:33:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c2b6f2b2-c6b7-4bb5-95bf-b34b8ffc9eeb tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-162fc042-e46d-4651-8355-05f4e239e785-delete_snapshot" released by "delete_snapshot" :: held 3.779s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "cinder-f7eb34d8-529a-4a50-bccf-64852fc590a3-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-f7eb34d8-529a-4a50-bccf-64852fc590a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "cinder-quobyte-f7eb34d8-529a-4a50-bccf-64852fc590a3" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-quobyte-f7eb34d8-529a-4a50-bccf-64852fc590a3" acquired by "delete_volume" :: waited 0.034s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:10 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3419080d-d357-4ba4-b8fb-69062e4b8ed9]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:10 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 Jul 05 17:33:10 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:11 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3" returned: 0 in 1.038s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:11 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3 Jul 05 17:33:11 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:12 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f7eb34d8-529a-4a50-bccf-64852fc590a3" returned: 0 in 0.864s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-quobyte-f7eb34d8-529a-4a50-bccf-64852fc590a3" released by "delete_volume" :: held 1.986s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Created reservations ['74997ffb-29e5-41f8-b511-a9f9195fda0f', '197a4363-053f-4ffc-b3bc-549eecac5169', '006b40ea-4f34-4c3d-8aea-e1116eaade9a', 'd8e88bb6-6d50-41f6-8879-edfba0af1119'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:12 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:12 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "cinder-5fec5ab3-d476-4998-99d2-d47f92e17a2a-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-5fec5ab3-d476-4998-99d2-d47f92e17a2a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "cinder-quobyte-5fec5ab3-d476-4998-99d2-d47f92e17a2a" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-quobyte-5fec5ab3-d476-4998-99d2-d47f92e17a2a" acquired by "delete_volume" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce1e0e8-ec1c-4cd6-b138-dfdbeb248a85]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:12 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a Jul 05 17:33:12 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:13 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.980s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:13 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Deleted volume successfully. Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-528f7506-1cfb-4483-b355-22e7277fc754 tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-f7eb34d8-529a-4a50-bccf-64852fc590a3-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-88634c8b-b59c-4e32-b262-f4b2965d0fa1 req-5c281515-8655-473b-9f60-b9b13895932a tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-88634c8b-b59c-4e32-b262-f4b2965d0fa1 req-5c281515-8655-473b-9f60-b9b13895932a tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc900242-a31a-4771-967f-8f28f3c4b7c4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-88634c8b-b59c-4e32-b262-f4b2965d0fa1 req-5c281515-8655-473b-9f60-b9b13895932a tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:13 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a" returned: 0 in 1.160s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:13 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 Jul 05 17:33:13 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:13 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a Jul 05 17:33:13 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (70a4cf44-4570-4c15-b0a6-fea2a0776db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ee7054-8302-4c00-8122-6f5be3fbae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ee7054-8302-4c00-8122-6f5be3fbae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2121001841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a8a35e-ffed-40dd-be6f-1e3ed5003b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:14Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5363f1b2-5c8d-47b7-a228-6a530df3f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5363f1b2-5c8d-47b7-a228-6a530df3f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66756cd-14cd-4234-ac41-27168d08e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66756cd-14cd-4234-ac41-27168d08e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a8a35e-ffed-40dd-be6f-1e3ed5003b78', 'volume_name': 'volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256514a9-1018-4173-a06f-ab5a82f60569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256514a9-1018-4173-a06f-ab5a82f60569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048f43f2-890e-4964-88b2-becd11c91490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:14 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Volume a6a8a35e-ffed-40dd-be6f-1e3ed5003b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78', 'volume_size': 1} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (c749619a-98d4-48ef-ad44-fe71c466aa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d49f97-4496-4306-b722-f62d28282b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d49f97-4496-4306-b722-f62d28282b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1984037524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a26186-ca82-4072-b63f-1524579ec8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:15Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d5aa6d-4a2b-4142-9bdb-d293dae54c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d5aa6d-4a2b-4142-9bdb-d293dae54c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49568dc3-8fdd-4471-a406-5779d6a28be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49568dc3-8fdd-4471-a406-5779d6a28be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a26186-ca82-4072-b63f-1524579ec8d8', 'volume_name': 'volume-34a26186-ca82-4072-b63f-1524579ec8d8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6dbf09-f7bd-4427-9b1b-73c6993a01bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6dbf09-f7bd-4427-9b1b-73c6993a01bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb9c852-618e-49d5-835c-fdb23f356d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Volume 34a26186-ca82-4072-b63f-1524579ec8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a26186-ca82-4072-b63f-1524579ec8d8', 'volume_size': 1} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:15 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-88634c8b-b59c-4e32-b262-f4b2965d0fa1 req-5c281515-8655-473b-9f60-b9b13895932a tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87" returned: 0 in 1.518s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-88634c8b-b59c-4e32-b262-f4b2965d0fa1 req-5c281515-8655-473b-9f60-b9b13895932a tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.544s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.975s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2121001841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a8a35e-ffed-40dd-be6f-1e3ed5003b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:14Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Creating volume a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:15 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:15 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:15 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 1073741824 Jul 05 17:33:15 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5fec5ab3-d476-4998-99d2-d47f92e17a2a" returned: 0 in 1.450s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-quobyte-5fec5ab3-d476-4998-99d2-d47f92e17a2a" released by "delete_volume" :: held 2.725s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (b6a473c6-01f0-497c-afb9-3c25c1f32273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df81735f-f042-46a1-8915-eff7ae9fdd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-88634c8b-b59c-4e32-b262-f4b2965d0fa1 req-5c281515-8655-473b-9f60-b9b13895932a tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-42d9003c-fc7b-421c-aa97-881da4fb4f87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9e9d8ad-5678-4634-806a-940690f2d01a', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df81735f-f042-46a1-8915-eff7ae9fdd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105448835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f7c644-934c-42a5-8431-d364d58e1017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:15Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d925e5-c09f-4fd3-bec4-22fea5fa57e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d925e5-c09f-4fd3-bec4-22fea5fa57e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70dde98e-2654-46b0-84a3-be82eceeb314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70dde98e-2654-46b0-84a3-be82eceeb314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f7c644-934c-42a5-8431-d364d58e1017', 'volume_name': 'volume-f9f7c644-934c-42a5-8431-d364d58e1017', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d675b285-ef1f-48fb-a41c-93bf79e78f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d675b285-ef1f-48fb-a41c-93bf79e78f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b250730-8fa6-46b1-8747-f2b0cc47bda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:15 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Volume f9f7c644-934c-42a5-8431-d364d58e1017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f7c644-934c-42a5-8431-d364d58e1017', 'volume_size': 1} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:15 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-88634c8b-b59c-4e32-b262-f4b2965d0fa1 req-5c281515-8655-473b-9f60-b9b13895932a tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] attachment_update completed successfully. Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Created reservations ['0fc697b4-cc06-4835-b32a-790dce49d4b2', '0cf60bc3-64af-4d7c-bee5-be7d17e30643', '6c41f0e4-ef78-4a05-b14e-dcf590323464', '6df5cb14-f57e-42b0-978a-059391ec2663'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:16 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:16 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (ac3b10c3-53eb-482e-bb85-0ac78c3f65db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff5ae80-6307-41b1-a37a-6c97dedafd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff5ae80-6307-41b1-a37a-6c97dedafd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-23888534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bf1af4-900e-4e49-95f8-d9302720a135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:16Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff22367-24f5-4580-9d44-f198e90af4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff22367-24f5-4580-9d44-f198e90af4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f255d16d-17a5-450e-9c0e-cd14791fc686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f255d16d-17a5-450e-9c0e-cd14791fc686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68bf1af4-900e-4e49-95f8-d9302720a135', 'volume_name': 'volume-68bf1af4-900e-4e49-95f8-d9302720a135', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be09f1d5-e95a-48e0-a494-600e6b247e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be09f1d5-e95a-48e0-a494-600e6b247e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c73892b-6eb8-4015-967d-a9164ad3c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:16 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Volume 68bf1af4-900e-4e49-95f8-d9302720a135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68bf1af4-900e-4e49-95f8-d9302720a135', 'volume_size': 1} Jul 05 17:33:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (ae10b750-2c5b-479d-9d46-04dc7ea38688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b5627b-cafb-4f4f-b0a5-9a6a78843e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:17 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b5627b-cafb-4f4f-b0a5-9a6a78843e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311344843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d08a131-eea8-4821-a675-03291e520f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:17Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce66bb4-6c4b-4013-baa7-194df6fbe24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce66bb4-6c4b-4013-baa7-194df6fbe24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b494a05e-fa79-44e3-b90c-43113bce9d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b494a05e-fa79-44e3-b90c-43113bce9d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d08a131-eea8-4821-a675-03291e520f27', 'volume_name': 'volume-2d08a131-eea8-4821-a675-03291e520f27', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de90672b-dbd0-4c8e-9003-cee99c834eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de90672b-dbd0-4c8e-9003-cee99c834eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febbadd7-5587-4264-9692-62c5081ed1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:17 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Volume 2d08a131-eea8-4821-a675-03291e520f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d08a131-eea8-4821-a675-03291e520f27', 'volume_size': 1} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 1073741824" returned: 0 in 1.990s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:17 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 Jul 05 17:33:17 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:17 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.697s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Deleted volume successfully. Jul 05 17:33:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b374bb3-ae5a-4a4c-9c31-5f1e8decd390 tempest-CinderUnicodeTest-2139879188 None] Lock "cinder-5fec5ab3-d476-4998-99d2-d47f92e17a2a-delete_volume" released by "delete_volume" :: held 5.081s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:18 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78" returned: 0 in 1.268s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] <== create_volume: return (3359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.365s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.638s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1984037524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a26186-ca82-4072-b63f-1524579ec8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:15Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Creating volume 34a26186-ca82-4072-b63f-1524579ec8d8 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:18 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048f43f2-890e-4964-88b2-becd11c91490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602deefc-8939-4c88-9070-0afa3402f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:18 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 1073741824 Jul 05 17:33:18 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:18 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Volume volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 (a6a8a35e-ffed-40dd-be6f-1e3ed5003b78): created successfully Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602deefc-8939-4c88-9070-0afa3402f230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (70a4cf44-4570-4c15-b0a6-fea2a0776db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:18 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-73e6b1fe-e5f8-4057-b2fd-9ce39977d7f0 tempest-CreateVolumesFromImageTest-1086011741 None] Created volume successfully. Jul 05 17:33:20 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 1073741824" returned: 0 in 1.680s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:20 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=84,cinder:INSERT=35,cinder:UPDATE=92,cinder:DELETE=9 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:33:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:20 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 Jul 05 17:33:20 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:21 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8" returned: 0 in 0.889s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] <== create_volume: return (2660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.666s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.744s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105448835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f7c644-934c-42a5-8431-d364d58e1017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:15Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Creating volume f9f7c644-934c-42a5-8431-d364d58e1017 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:21 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb9c852-618e-49d5-835c-fdb23f356d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a26186-ca82-4072-b63f-1524579ec8d8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5424d5db-e5c8-4ed9-a4dd-133544fd9ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:21 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Volume volume-34a26186-ca82-4072-b63f-1524579ec8d8 (34a26186-ca82-4072-b63f-1524579ec8d8): created successfully Jul 05 17:33:21 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 1073741824 Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5424d5db-e5c8-4ed9-a4dd-133544fd9ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:21 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (c749619a-98d4-48ef-ad44-fe71c466aa84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:21 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-aaf71318-ca01-443d-8f35-c8fcbaa04dc0 tempest-CreateVolumesFromImageTest-1086011741 None] Created volume successfully. Jul 05 17:33:21 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=95,cinder:SELECT=97,cinder:INSERT=32,cinder:DELETE=8 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:33:23 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 1073741824" returned: 0 in 1.876s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:23 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 Jul 05 17:33:23 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:24 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017" returned: 0 in 1.130s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] <== create_volume: return (3125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.135s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.145s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-23888534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bf1af4-900e-4e49-95f8-d9302720a135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:16Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Creating volume 68bf1af4-900e-4e49-95f8-d9302720a135 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:24 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b250730-8fa6-46b1-8747-f2b0cc47bda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f7c644-934c-42a5-8431-d364d58e1017', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4e8dc6-4625-4da2-a28b-44439361ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:24 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 1073741824 Jul 05 17:33:24 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:24 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Volume volume-f9f7c644-934c-42a5-8431-d364d58e1017 (f9f7c644-934c-42a5-8431-d364d58e1017): created successfully Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4e8dc6-4625-4da2-a28b-44439361ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (b6a473c6-01f0-497c-afb9-3c25c1f32273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:24 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7b05c01b-9208-42fe-b8e0-639393feaba1 tempest-CreateVolumesFromImageTest-1086011741 None] Created volume successfully. Jul 05 17:33:24 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-d38ae761-73ec-4b1d-ba92-566cbf5486a8 req-981e682a-2453-439f-b042-05a1df5f0767 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Terminate volume connection completed successfully. Jul 05 17:33:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d38ae761-73ec-4b1d-ba92-566cbf5486a8 req-981e682a-2453-439f-b042-05a1df5f0767 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Deleting attachment f9e9d8ad-5678-4634-806a-940690f2d01a. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:33:25 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 1073741824" returned: 0 in 1.393s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:26 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 Jul 05 17:33:26 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:26 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135" returned: 0 in 1.012s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] <== create_volume: return (2461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.466s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.652s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311344843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d08a131-eea8-4821-a675-03291e520f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93fe1aba146ed866a486e983cc259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:17Z,use_quota=True,user_id='b13d851731294daa8e2bf4039820c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Creating volume 2d08a131-eea8-4821-a675-03291e520f27 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:27 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c73892b-6eb8-4015-967d-a9164ad3c824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bf1af4-900e-4e49-95f8-d9302720a135', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b40c27e-387c-4f51-b20c-65e06bfe25df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:27 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 1073741824 Jul 05 17:33:27 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Acquiring lock "cinder-42d9003c-fc7b-421c-aa97-881da4fb4f87-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:27 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Volume volume-68bf1af4-900e-4e49-95f8-d9302720a135 (68bf1af4-900e-4e49-95f8-d9302720a135): created successfully Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b40c27e-387c-4f51-b20c-65e06bfe25df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (ac3b10c3-53eb-482e-bb85-0ac78c3f65db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "cinder-42d9003c-fc7b-421c-aa97-881da4fb4f87-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-08f71a56-4de2-4cc4-a138-9cc884e062c5 tempest-CreateVolumesFromImageTest-1086011741 None] Created volume successfully. Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Acquiring lock "cinder-quobyte-42d9003c-fc7b-421c-aa97-881da4fb4f87" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "cinder-quobyte-42d9003c-fc7b-421c-aa97-881da4fb4f87" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c691e-a921-4338-8096-a252241f48db]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:27 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 Jul 05 17:33:27 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:28 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87" returned: 0 in 1.187s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:28 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 1073741824" returned: 0 in 1.544s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:28 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87 Jul 05 17:33:28 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:28 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 Jul 05 17:33:28 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:29 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-42d9003c-fc7b-421c-aa97-881da4fb4f87" returned: 0 in 0.844s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "cinder-quobyte-42d9003c-fc7b-421c-aa97-881da4fb4f87" released by "delete_volume" :: held 2.102s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Created reservations ['c868e27d-19db-4fcf-bee8-6e511d6b1b77', '3b28addd-b22e-4d1e-b1e8-5cc34597b295', '4fc72dca-5a74-40f2-bac3-d20a6b698884', '39fb2457-0daa-4721-8998-569fd6ee1b82'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:29 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27" returned: 0 in 0.908s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.532s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febbadd7-5587-4264-9692-62c5081ed1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d08a131-eea8-4821-a675-03291e520f27', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577c0b3d-f671-4dc0-9f20-5475d67855f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:29 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Volume volume-2d08a131-eea8-4821-a675-03291e520f27 (2d08a131-eea8-4821-a675-03291e520f27): created successfully Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577c0b3d-f671-4dc0-9f20-5475d67855f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:29 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Flow 'volume_create_manager' (ae10b750-2c5b-479d-9d46-04dc7ea38688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:29 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c5db1db1-795a-4d4d-8b05-641a7ee97166 tempest-CreateVolumesFromImageTest-1086011741 None] Created volume successfully. Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-2d08a131-eea8-4821-a675-03291e520f27-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-2d08a131-eea8-4821-a675-03291e520f27-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-quobyte-2d08a131-eea8-4821-a675-03291e520f27" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-2d08a131-eea8-4821-a675-03291e520f27" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ee893f-bb0a-42e0-bc7f-6c2a46996016]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:30 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 Jul 05 17:33:30 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:30 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.820s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:30 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:30 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Deleted volume successfully. Jul 05 17:33:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-69a678d2-5202-4543-902f-d50d9b137c72 tempest-TestServerVolumeAttachScenarioOldVersion-524660754 None] Lock "cinder-42d9003c-fc7b-421c-aa97-881da4fb4f87-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:31 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27" returned: 0 in 1.245s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:31 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27 Jul 05 17:33:31 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:31 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d08a131-eea8-4821-a675-03291e520f27" returned: 0 in 0.737s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-2d08a131-eea8-4821-a675-03291e520f27" released by "delete_volume" :: held 2.044s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Created reservations ['dd0db626-43cb-4a3b-9623-b417a84b14e8', 'e28fca1a-5cf2-4868-998a-39b0ad4687b6', '26f2c54a-c5a3-412a-9adc-89ebd402472e', '838ae2bc-594d-4664-8455-e6acfbad4031'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:32 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:32 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:32 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.769s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Deleted volume successfully. Jul 05 17:33:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-92aed8ee-51cd-467d-a829-de5e129f2ea5 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-2d08a131-eea8-4821-a675-03291e520f27-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-68bf1af4-900e-4e49-95f8-d9302720a135-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-68bf1af4-900e-4e49-95f8-d9302720a135-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-quobyte-68bf1af4-900e-4e49-95f8-d9302720a135" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-68bf1af4-900e-4e49-95f8-d9302720a135" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:33 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc29cf61-cc2a-4a6a-b209-4ba81de4af39]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:33 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 Jul 05 17:33:33 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:34 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135" returned: 0 in 0.969s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:34 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135 Jul 05 17:33:34 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:35 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-68bf1af4-900e-4e49-95f8-d9302720a135" returned: 0 in 0.663s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-68bf1af4-900e-4e49-95f8-d9302720a135" released by "delete_volume" :: held 1.693s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Created reservations ['3c8d5565-74df-4677-85e4-fb1232ce0677', 'e7709312-4d70-4980-9943-537bc6b9329a', '8579ab94-add4-49a3-8bea-cbccf03a2341', '048dca7f-29ff-4723-95f4-d477894915cd'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:35 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:35 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-f9f7c644-934c-42a5-8431-d364d58e1017-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-f9f7c644-934c-42a5-8431-d364d58e1017-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-quobyte-f9f7c644-934c-42a5-8431-d364d58e1017" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-f9f7c644-934c-42a5-8431-d364d58e1017" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c427fa-bbfa-482c-923d-9ae38e60d280]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:35 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 Jul 05 17:33:35 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:35 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.705s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:35 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Deleted volume successfully. Jul 05 17:33:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-34c759c8-781e-4d1f-a22c-39ae8a5aa4a7 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-68bf1af4-900e-4e49-95f8-d9302720a135-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:36 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017" returned: 0 in 0.831s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:36 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017 Jul 05 17:33:36 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:37 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f9f7c644-934c-42a5-8431-d364d58e1017" returned: 0 in 0.686s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-f9f7c644-934c-42a5-8431-d364d58e1017" released by "delete_volume" :: held 1.575s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Created reservations ['4d6619c5-e69c-4ab8-8abf-90af6a4ed7c8', 'ba0137de-6ca9-4f68-b0c4-988650ce5022', 'dcd6a7c8-ff09-471c-a62f-9bee94685dc5', '4bc007ae-03bb-450b-abf6-009f96479a28'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:37 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:37 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-34a26186-ca82-4072-b63f-1524579ec8d8-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-34a26186-ca82-4072-b63f-1524579ec8d8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-quobyte-34a26186-ca82-4072-b63f-1524579ec8d8" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-34a26186-ca82-4072-b63f-1524579ec8d8" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad5f95b-0db8-458f-bb32-ca4e5bcf39bf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:38 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.694s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:38 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Deleted volume successfully. Jul 05 17:33:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6ee30ef8-ba5a-4a71-9c35-3dc4afeb3808 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-f9f7c644-934c-42a5-8431-d364d58e1017-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:38 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 Jul 05 17:33:38 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:38 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8" returned: 0 in 1.006s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:38 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8 Jul 05 17:33:38 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:39 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-34a26186-ca82-4072-b63f-1524579ec8d8" returned: 0 in 0.716s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-34a26186-ca82-4072-b63f-1524579ec8d8" released by "delete_volume" :: held 1.830s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Created reservations ['15840287-300c-4d3a-9085-3a9e7a6058ee', 'ef5e7277-5ed3-4bfd-a9d8-ec5770f4dee4', '3af1e98b-2259-4856-94ba-dd753fc210b5', '3ff1bc68-9108-4cf7-9e72-143ae2c2fde4'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:39 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:39 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "cinder-quobyte-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff8dd56-bb4b-4803-9a1d-ee39242dc90a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:40 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 Jul 05 17:33:40 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:40 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.916s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Deleted volume successfully. Jul 05 17:33:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-01511bce-6e83-4920-9024-64d114748237 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-34a26186-ca82-4072-b63f-1524579ec8d8-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:41 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78" returned: 0 in 0.939s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:41 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78 Jul 05 17:33:41 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:41 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78" returned: 0 in 0.714s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-quobyte-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78" released by "delete_volume" :: held 1.710s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:42 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Created reservations ['f37b03dc-a2c7-47fd-9416-4ca86057ea98', 'cf37277d-7312-4b92-b5cf-67d67b6ad1d3', '60a1ecbf-d977-4965-a57c-edac88d09708', 'ad47610a-6665-4605-8f25-74cb2f5eacba'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:42 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:42 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:43 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.798s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:43 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:43 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Deleted volume successfully. Jul 05 17:33:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d87cf67a-782f-4e34-9b10-5ea4d4ceab80 tempest-CreateVolumesFromImageTest-1086011741 None] Lock "cinder-a6a8a35e-ffed-40dd-be6f-1e3ed5003b78-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (b2903b46-6c20-40ea-94c1-3ebb8291fe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bdf3d2-10bf-44a6-b21f-abcc86b163b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bdf3d2-10bf-44a6-b21f-abcc86b163b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1664357196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:46Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9084b247-3364-4e7d-9948-ceeb1fb3b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9084b247-3364-4e7d-9948-ceeb1fb3b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb74cd2-1269-4716-bde2-311ec7c81ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb74cd2-1269-4716-bde2-311ec7c81ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad', 'volume_name': 'volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59b918b-1a37-491c-8cb5-24f4968c7768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59b918b-1a37-491c-8cb5-24f4968c7768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3ed1b8-3ff5-4901-9b6e-ec287f31d089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:45 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad', 'volume_size': 1} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1664357196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:46Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Creating volume fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:45 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:45 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad 1073741824 Jul 05 17:33:45 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:46 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad 1073741824" returned: 0 in 0.986s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:46 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad Jul 05 17:33:46 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:47 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad" returned: 0 in 0.741s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3ed1b8-3ff5-4901-9b6e-ec287f31d089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34613534-3c34-4631-8edf-eabbd3f5e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:47 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad (fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad): created successfully Jul 05 17:33:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34613534-3c34-4631-8edf-eabbd3f5e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (b2903b46-6c20-40ea-94c1-3ebb8291fe00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f04d51ef-d7ad-4476-afc2-2e8e925e8405 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created volume successfully. Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (bb0d9e74-619c-4462-b7ba-9b5ccb21886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efce3a65-cefe-43a4-b88b-afb04f522401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efce3a65-cefe-43a4-b88b-afb04f522401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-190500792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033721bd-24f3-402f-8719-df5fd95126bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:48Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6073f9e3-5691-4b74-a3d4-61369f918081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6073f9e3-5691-4b74-a3d4-61369f918081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4880ac-cf4f-4862-ba6e-d2ba6b3a4ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4880ac-cf4f-4862-ba6e-d2ba6b3a4ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '033721bd-24f3-402f-8719-df5fd95126bf', 'volume_name': 'volume-033721bd-24f3-402f-8719-df5fd95126bf', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2494c4c2-b599-42ed-83dc-ee8cc834d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2494c4c2-b599-42ed-83dc-ee8cc834d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153a1ecb-806e-47a2-bc8d-e969c0cfbaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume 033721bd-24f3-402f-8719-df5fd95126bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-033721bd-24f3-402f-8719-df5fd95126bf', 'volume_size': 1} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-190500792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033721bd-24f3-402f-8719-df5fd95126bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:48Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Creating volume 033721bd-24f3-402f-8719-df5fd95126bf {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:48 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:48 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf 1073741824 Jul 05 17:33:48 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (f1b65e97-f06a-430e-8c6a-4bdb76d9b443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920fbe5d-3d14-4429-8b37-9647d778ca19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920fbe5d-3d14-4429-8b37-9647d778ca19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528862134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfa8c32-baf7-4504-bab4-02cac83d9d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:49Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08e41c4-c129-43cf-b338-66e6288ba135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08e41c4-c129-43cf-b338-66e6288ba135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f906dfb4-beca-4076-81da-dc01d4ffff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f906dfb4-beca-4076-81da-dc01d4ffff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcfa8c32-baf7-4504-bab4-02cac83d9d4d', 'volume_name': 'volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388c1665-af12-4354-88aa-2c2fa3ea3faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388c1665-af12-4354-88aa-2c2fa3ea3faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:48 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f73d55-257b-4bef-aee7-7c30da6bb7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume bcfa8c32-baf7-4504-bab4-02cac83d9d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d', 'volume_size': 1} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (41496b1d-b2f0-4611-9a4e-a53f4cba57d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b183978-3c34-456c-8659-59778a295e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b183978-3c34-456c-8659-59778a295e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1759358329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bacba0-df7b-4d19-b86b-ae26fffad559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:49Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cd28be-b080-43b5-9914-42fa2138bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cd28be-b080-43b5-9914-42fa2138bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7e3f2d-dd38-4fff-a02e-c79067321bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7e3f2d-dd38-4fff-a02e-c79067321bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79bacba0-df7b-4d19-b86b-ae26fffad559', 'volume_name': 'volume-79bacba0-df7b-4d19-b86b-ae26fffad559', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918654ba-b6dd-4fa7-b7a5-633dd3f5bf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918654ba-b6dd-4fa7-b7a5-633dd3f5bf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f551ed-d414-4040-ae4d-0e0883371b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume 79bacba0-df7b-4d19-b86b-ae26fffad559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79bacba0-df7b-4d19-b86b-ae26fffad559', 'volume_size': 1} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:49 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf 1073741824" returned: 0 in 1.073s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:49 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf Jul 05 17:33:49 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (e4419d13-3000-4344-ac01-2f0b3ed470e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819630fd-3ca7-4148-908c-3480bcae676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819630fd-3ca7-4148-908c-3480bcae676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99585286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7695cc30-e6bd-454e-8aad-342272979c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:50Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d75073-44c0-4bc5-8ded-69cfd30d151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d75073-44c0-4bc5-8ded-69cfd30d151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afae88f8-4d17-4197-857a-cf3b0671e007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afae88f8-4d17-4197-857a-cf3b0671e007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7695cc30-e6bd-454e-8aad-342272979c1c', 'volume_name': 'volume-7695cc30-e6bd-454e-8aad-342272979c1c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499e1488-6b8e-4c03-999e-c50a9881d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499e1488-6b8e-4c03-999e-c50a9881d41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16df54a9-2b1b-4785-b58f-b47ec83eacaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume 7695cc30-e6bd-454e-8aad-342272979c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7695cc30-e6bd-454e-8aad-342272979c1c', 'volume_size': 1} Jul 05 17:33:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (8dadf347-b9b9-4025-935a-82d75ca2a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4912074a-c6da-45cf-b573-bf50ba763cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4912074a-c6da-45cf-b573-bf50ba763cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133649642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f82be7a-98fa-470f-b760-218484f0b8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:50Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd085e2f-8623-4ce5-a25b-da2a00274910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd085e2f-8623-4ce5-a25b-da2a00274910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec02e2a-d702-4fcf-a20f-22797bb50209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec02e2a-d702-4fcf-a20f-22797bb50209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f82be7a-98fa-470f-b760-218484f0b8fa', 'volume_name': 'volume-3f82be7a-98fa-470f-b760-218484f0b8fa', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a17647-0291-4e3e-9f10-66a576a8404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a17647-0291-4e3e-9f10-66a576a8404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00220d4-f68d-43d5-a2e6-e513706366d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:50 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume 3f82be7a-98fa-470f-b760-218484f0b8fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f82be7a-98fa-470f-b760-218484f0b8fa', 'volume_size': 1} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-5277ad25-99cb-4200-b7da-b60c8f7782b5 req-fe9b445f-96c6-4f59-83b9-f68de23b07e1 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:50 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf" returned: 0 in 0.901s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528862134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfa8c32-baf7-4504-bab4-02cac83d9d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:49Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Creating volume bcfa8c32-baf7-4504-bab4-02cac83d9d4d {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:50 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:50 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d 1073741824 Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153a1ecb-806e-47a2-bc8d-e969c0cfbaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-033721bd-24f3-402f-8719-df5fd95126bf', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:50 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0193f480-7355-48e3-92e6-d4fd5c25adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:50 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume volume-033721bd-24f3-402f-8719-df5fd95126bf (033721bd-24f3-402f-8719-df5fd95126bf): created successfully Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0193f480-7355-48e3-92e6-d4fd5c25adba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (bb0d9e74-619c-4462-b7ba-9b5ccb21886c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:50 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c1c2ec76-707c-425f-8305-4d23cace2b87 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created volume successfully. Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:50 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:50 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:51 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d 1073741824" returned: 0 in 0.926s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:51 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.741s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:33:51 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d Jul 05 17:33:51 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:33:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:33:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:33:52 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d" returned: 0 in 0.727s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.937s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1759358329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bacba0-df7b-4d19-b86b-ae26fffad559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:49Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Creating volume 79bacba0-df7b-4d19-b86b-ae26fffad559 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:52 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f73d55-257b-4bef-aee7-7c30da6bb7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694e6fa9-0d92-4520-8f4b-3dfab9ed64a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:52 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 1073741824 Jul 05 17:33:52 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:52 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d (bcfa8c32-baf7-4504-bab4-02cac83d9d4d): created successfully Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694e6fa9-0d92-4520-8f4b-3dfab9ed64a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (f1b65e97-f06a-430e-8c6a-4bdb76d9b443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:52 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4bed63c0-4a67-4b37-9951-ff6a5c38a176 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created volume successfully. Jul 05 17:33:53 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 1073741824" returned: 0 in 0.905s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:53 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 Jul 05 17:33:53 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:53 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559" returned: 0 in 0.675s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.989s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99585286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7695cc30-e6bd-454e-8aad-342272979c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:50Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Creating volume 7695cc30-e6bd-454e-8aad-342272979c1c {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:53 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:53 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c 1073741824 Jul 05 17:33:53 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f551ed-d414-4040-ae4d-0e0883371b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79bacba0-df7b-4d19-b86b-ae26fffad559', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7689b47b-bfe7-4527-9d9e-379ba3a01210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:53 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume volume-79bacba0-df7b-4d19-b86b-ae26fffad559 (79bacba0-df7b-4d19-b86b-ae26fffad559): created successfully Jul 05 17:33:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7689b47b-bfe7-4527-9d9e-379ba3a01210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (41496b1d-b2f0-4611-9a4e-a53f4cba57d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f1358f9c-8dad-4c67-aded-710a37aa6909 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created volume successfully. Jul 05 17:33:54 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c 1073741824" returned: 0 in 0.861s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:54 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c Jul 05 17:33:54 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:55 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.143s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133649642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f82be7a-98fa-470f-b760-218484f0b8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a80cf30f163422c9de3b822f921514a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:33:50Z,use_quota=True,user_id='19dd7d8c4226440197a8e41c54988170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Creating volume 3f82be7a-98fa-470f-b760-218484f0b8fa {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:33:55 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:55 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa 1073741824 Jul 05 17:33:55 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16df54a9-2b1b-4785-b58f-b47ec83eacaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7695cc30-e6bd-454e-8aad-342272979c1c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0604bb80-5694-4a84-8cdf-ef91bb777dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:55 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume volume-7695cc30-e6bd-454e-8aad-342272979c1c (7695cc30-e6bd-454e-8aad-342272979c1c): created successfully Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0604bb80-5694-4a84-8cdf-ef91bb777dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (e4419d13-3000-4344-ac01-2f0b3ed470e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9ca49820-8a54-49cb-8482-5b368d665f63 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created volume successfully. Jul 05 17:33:56 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa 1073741824" returned: 0 in 0.963s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:56 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa Jul 05 17:33:56 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:57 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa" returned: 0 in 0.787s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-5277ad25-99cb-4200-b7da-b60c8f7782b5 req-fe9b445f-96c6-4f59-83b9-f68de23b07e1 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.953s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00220d4-f68d-43d5-a2e6-e513706366d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f82be7a-98fa-470f-b760-218484f0b8fa', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76fa92f-c8fa-45b5-b8ba-b3629791815b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aa1b50-f0ee-4283-9edb-890cb5927e0f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-5277ad25-99cb-4200-b7da-b60c8f7782b5 req-fe9b445f-96c6-4f59-83b9-f68de23b07e1 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Volume volume-3f82be7a-98fa-470f-b760-218484f0b8fa (3f82be7a-98fa-470f-b760-218484f0b8fa): created successfully Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76fa92f-c8fa-45b5-b8ba-b3629791815b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Flow 'volume_create_manager' (8dadf347-b9b9-4025-935a-82d75ca2a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:33:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-928e27e0-971c-4f6a-b7cb-18f150adce2b tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created volume successfully. Jul 05 17:33:57 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 Jul 05 17:33:57 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-3f82be7a-98fa-470f-b760-218484f0b8fa-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-3f82be7a-98fa-470f-b760-218484f0b8fa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-quobyte-3f82be7a-98fa-470f-b760-218484f0b8fa" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:33:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-3f82be7a-98fa-470f-b760-218484f0b8fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:33:58 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3632a8-6c99-4138-a546-14c221dada69]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:33:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:58 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa Jul 05 17:33:58 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:58 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-5277ad25-99cb-4200-b7da-b60c8f7782b5 req-fe9b445f-96c6-4f59-83b9-f68de23b07e1 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986" returned: 0 in 0.849s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-5277ad25-99cb-4200-b7da-b60c8f7782b5 req-fe9b445f-96c6-4f59-83b9-f68de23b07e1 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-5277ad25-99cb-4200-b7da-b60c8f7782b5 req-fe9b445f-96c6-4f59-83b9-f68de23b07e1 tempest-TestInstancesWithCinderVolumes-1460434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-da6f917f-295a-46af-8d2c-c18c152b9986', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '651aac72-2f8d-4ead-9ace-35859b0fe49a', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:33:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-5277ad25-99cb-4200-b7da-b60c8f7782b5 req-fe9b445f-96c6-4f59-83b9-f68de23b07e1 tempest-TestInstancesWithCinderVolumes-1460434 None] attachment_update completed successfully. Jul 05 17:33:58 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa" returned: 0 in 0.766s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:58 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa Jul 05 17:33:58 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:33:59 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3f82be7a-98fa-470f-b760-218484f0b8fa" returned: 0 in 0.719s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-3f82be7a-98fa-470f-b760-218484f0b8fa" released by "delete_volume" :: held 1.531s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created reservations ['07f00fb9-b836-4183-bb37-4e18fa95c5d4', '5c86a6c7-3afd-4dc9-b0bb-c4fb667c5bbc', 'bf2154d1-24c6-4e0d-999f-0bb0b63b9e6a', 'fa5b4586-f3a3-4d2f-9fa6-d009a2d2e24a'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:33:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:33:59 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:33:59 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-7695cc30-e6bd-454e-8aad-342272979c1c-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-7695cc30-e6bd-454e-8aad-342272979c1c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-quobyte-7695cc30-e6bd-454e-8aad-342272979c1c" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-7695cc30-e6bd-454e-8aad-342272979c1c" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[195589f4-300c-4295-bcfc-c24bd1d9cf48]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:00 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c Jul 05 17:34:00 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:00 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.853s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Deleted volume successfully. Jul 05 17:34:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ce89f92b-e7cc-442e-8d1e-1ab3d4519484 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-3f82be7a-98fa-470f-b760-218484f0b8fa-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:01 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c" returned: 0 in 0.829s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:01 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c Jul 05 17:34:01 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:01 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7695cc30-e6bd-454e-8aad-342272979c1c" returned: 0 in 0.742s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-7695cc30-e6bd-454e-8aad-342272979c1c" released by "delete_volume" :: held 1.613s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created reservations ['0001e598-3fff-4d73-8254-418194d56ee4', '2acb31f6-decc-4e7d-9776-3e885770919c', 'ea92d25f-fc8a-453e-aa53-573cfcdbff84', 'bd7fd2bf-be77-442e-8f5a-82982de370ce'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:02 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:02 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-79bacba0-df7b-4d19-b86b-ae26fffad559-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-79bacba0-df7b-4d19-b86b-ae26fffad559-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-quobyte-79bacba0-df7b-4d19-b86b-ae26fffad559" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-79bacba0-df7b-4d19-b86b-ae26fffad559" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed95446c-12d4-4aff-8857-c378244f36d7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:02 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 Jul 05 17:34:02 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:02 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.694s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:02 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Deleted volume successfully. Jul 05 17:34:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c271609e-113b-4394-b246-c5fca1f666df tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-7695cc30-e6bd-454e-8aad-342272979c1c-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:03 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559" returned: 0 in 0.869s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:03 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559 Jul 05 17:34:03 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:04 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-79bacba0-df7b-4d19-b86b-ae26fffad559" returned: 0 in 0.715s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-79bacba0-df7b-4d19-b86b-ae26fffad559" released by "delete_volume" :: held 1.628s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created reservations ['9dac7e29-af9c-4786-b353-c8da7cf388c0', '56b330e2-8d0a-4608-88f1-4a1cdebfe685', '17293708-afcb-4998-9ff1-bc3d2aab03d9', '7ac131e7-6d2a-4b3c-8f28-38c6b1598c07'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:04 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:04 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-bcfa8c32-baf7-4504-bab4-02cac83d9d4d-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-bcfa8c32-baf7-4504-bab4-02cac83d9d4d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-quobyte-bcfa8c32-baf7-4504-bab4-02cac83d9d4d" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-bcfa8c32-baf7-4504-bab4-02cac83d9d4d" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf1d4d3-1f26-46ce-8fac-9b189cabf58d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:04 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d Jul 05 17:34:05 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:05 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.714s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:05 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Deleted volume successfully. Jul 05 17:34:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-20cfae5b-3fb7-4e14-bff2-cc8c0140568f tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-79bacba0-df7b-4d19-b86b-ae26fffad559-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:05 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d" returned: 0 in 1.004s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:05 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d Jul 05 17:34:05 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:06 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bcfa8c32-baf7-4504-bab4-02cac83d9d4d" returned: 0 in 0.703s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-bcfa8c32-baf7-4504-bab4-02cac83d9d4d" released by "delete_volume" :: held 1.770s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created reservations ['ce14f753-b5d8-4f75-bc97-32adb8c7d91b', '7cc237cb-d982-4f3b-802c-6a14b3ae3548', '9fa14f37-ce30-4701-9dc8-8e06d5c81f72', '11d04c7c-e363-4ff3-bceb-8b58dc5675e5'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-483d69ac-ab8b-4287-a941-931bda194ac5 req-095fcae7-36fa-49f5-a1f1-959605cb17de tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-483d69ac-ab8b-4287-a941-931bda194ac5 req-095fcae7-36fa-49f5-a1f1-959605cb17de tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec4d28c-b201-4841-901a-26784328a72d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-483d69ac-ab8b-4287-a941-931bda194ac5 req-095fcae7-36fa-49f5-a1f1-959605cb17de tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:06 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:06 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:06 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 Jul 05 17:34:06 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-033721bd-24f3-402f-8719-df5fd95126bf-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-033721bd-24f3-402f-8719-df5fd95126bf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-quobyte-033721bd-24f3-402f-8719-df5fd95126bf" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-033721bd-24f3-402f-8719-df5fd95126bf" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f1259-f2b6-4ea1-b1a1-0089681a8a11]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:07 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf Jul 05 17:34:07 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:07 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.776s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Deleted volume successfully. Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a6695df-a495-49cd-8395-12f2671088ab tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-bcfa8c32-baf7-4504-bab4-02cac83d9d4d-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:07 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-483d69ac-ab8b-4287-a941-931bda194ac5 req-095fcae7-36fa-49f5-a1f1-959605cb17de tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120" returned: 0 in 0.923s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-483d69ac-ab8b-4287-a941-931bda194ac5 req-095fcae7-36fa-49f5-a1f1-959605cb17de tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.951s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-483d69ac-ab8b-4287-a941-931bda194ac5 req-095fcae7-36fa-49f5-a1f1-959605cb17de tempest-TestInstancesWithCinderVolumes-1460434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-81e9d416-dac4-431f-b685-0c125e440120', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ef00d50-783c-4973-8a87-d0d049ec5ff0', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:34:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-483d69ac-ab8b-4287-a941-931bda194ac5 req-095fcae7-36fa-49f5-a1f1-959605cb17de tempest-TestInstancesWithCinderVolumes-1460434 None] attachment_update completed successfully. Jul 05 17:34:08 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf" returned: 0 in 0.882s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:08 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf Jul 05 17:34:08 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:08 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-033721bd-24f3-402f-8719-df5fd95126bf" returned: 0 in 0.736s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-033721bd-24f3-402f-8719-df5fd95126bf" released by "delete_volume" :: held 1.685s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created reservations ['df73f0ec-3496-41fd-8189-961c75a21edf', 'e49f8a52-df4f-4a47-989a-a178df8371d2', '4121b95d-23d1-46e9-bd4f-ad7247f7f835', 'b95dbdbe-d771-4747-bfcd-9d073a21e086'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:09 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:09 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "cinder-quobyte-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ed637-3420-4deb-a12e-a5cdc0929ecf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:09 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad Jul 05 17:34:09 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:09 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.773s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Deleted volume successfully. Jul 05 17:34:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6b18baf1-17e3-4677-bee3-d1fe53785df0 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-033721bd-24f3-402f-8719-df5fd95126bf-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:10 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad" returned: 0 in 0.809s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:10 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad Jul 05 17:34:10 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:11 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad" returned: 0 in 0.717s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-quobyte-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad" released by "delete_volume" :: held 1.580s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Created reservations ['1a2f2110-11a5-42ba-bec1-cdb9b919ad37', '51a11e97-437c-42a5-b3b0-b9e2188fdd17', '498f9fd6-b249-4634-9226-d00de8095fac', '11011633-6260-437c-8db3-ebd455749a8f'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:11 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:11 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:11 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.703s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:11 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Deleted volume successfully. Jul 05 17:34:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-11efff50-8c34-4d38-bde7-6bc77eaf88a1 tempest-CreateVolumesFromSourceVolumeTest-1171307402 None] Lock "cinder-fd47ccf4-98ee-4f70-8e08-38e9f4ea6dad-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Flow 'volume_create_manager' (a91007b9-b02e-41cb-a5d9-7ba23fa3b1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07354481-db59-4b52-85ef-b8782192503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07354481-db59-4b52-85ef-b8782192503e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1022988499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afd62761f0342e49a3253a968a53269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:34:17Z,use_quota=True,user_id='0d1540355eb64c43b086f5b5fe2d1ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636aa391-3edd-4dc2-8e81-a484be337d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636aa391-3edd-4dc2-8e81-a484be337d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2665055-eb3a-4ac5-a167-ce7e53602a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2665055-eb3a-4ac5-a167-ce7e53602a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf', 'volume_name': 'volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885f57da-97b8-439c-b9a4-d640073a3257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885f57da-97b8-439c-b9a4-d640073a3257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e722ea-4a1e-4a0a-a4bd-58b03538a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:34:16 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Volume 215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 17:34:16 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Trying to clone 215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf from image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:34:17 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:34:17 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Image download 20.69 MB at 20.69 MB/s Jul 05 17:34:17 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0ec912-fb91-40a0-a048-0e7e0536a4cb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:17 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD Jul 05 17:34:17 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-a27ea0a0-d5b5-4769-a508-d554a4dce8da req-1210d53b-1cb3-42cf-8c53-4506a04677dc tempest-TestInstancesWithCinderVolumes-1460434 None] Terminate volume connection completed successfully. Jul 05 17:34:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-a27ea0a0-d5b5-4769-a508-d554a4dce8da req-1210d53b-1cb3-42cf-8c53-4506a04677dc tempest-TestInstancesWithCinderVolumes-1460434 None] Deleting attachment 651aac72-2f8d-4ead-9ace-35859b0fe49a. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:34:18 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Temporary image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 is fetched for user 0d1540355eb64c43b086f5b5fe2d1ab2. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f66782-06dd-4c5d-9dc5-94445cbd6042]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:18 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD Jul 05 17:34:18 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:18 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD" returned: 0 in 0.765s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1022988499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afd62761f0342e49a3253a968a53269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:34:17Z,use_quota=True,user_id='0d1540355eb64c43b086f5b5fe2d1ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Creating volume 215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:34:18 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:34:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:18 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf 1073741824 Jul 05 17:34:18 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:19 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf 1073741824" returned: 0 in 0.809s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "cinder-da6f917f-295a-46af-8d2c-c18c152b9986-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:19 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:34:19 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-da6f917f-295a-46af-8d2c-c18c152b9986-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "cinder-quobyte-da6f917f-295a-46af-8d2c-c18c152b9986" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-quobyte-da6f917f-295a-46af-8d2c-c18c152b9986" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:19 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aaecd7-d049-4104-b390-9aea41463a94]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:19 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 Jul 05 17:34:19 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:20 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 0 in 0.659s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:34:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:20 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Attempting download of ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}])) to volume 215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:34:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b0ead1-3e15-471e-b6a5-ce8f38f77830]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_chomhkj3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:20 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_chomhkj3 Jul 05 17:34:20 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:20 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986" returned: 0 in 0.796s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:20 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986 Jul 05 17:34:20 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:21 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_chomhkj3" returned: 0 in 0.777s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_chomhkj3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:21 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-da6f917f-295a-46af-8d2c-c18c152b9986" returned: 0 in 0.662s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-quobyte-da6f917f-295a-46af-8d2c-c18c152b9986" released by "delete_volume" :: held 1.502s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=134,cinder:SELECT=89,cinder:DELETE=11,cinder:INSERT=30 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:34:21 devstack cinder-volume[86459]: WARNING cinder.quota [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1359126045-419443956 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1359126045-419443956, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:34:21 devstack cinder-volume[86459]: WARNING cinder.quota [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1359126045-419443956 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1359126045-419443956, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:34:21 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_chomhkj3 Jul 05 17:34:21 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Created reservations ['a8188bd6-2dc6-46df-b998-5d8c696435f3', 'ba4336f9-05cb-40d8-80c4-3d0111d64a4d', '62ce1fef-bae0-40a5-9cfb-d3b742ba7daf', '189f0e7d-a68e-4dec-8201-f9794889de0b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:21 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:21 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:22 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_chomhkj3" returned: 1 in 0.792s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_chomhkj3' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[730f24fe-f8f6-4163-9e42-9df0be30cd3d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:22 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.663s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:22 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Deleted volume successfully. Jul 05 17:34:22 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD Jul 05 17:34:22 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d32dd8b0-efbd-4e53-be45-8bf1d73aa2e2 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-da6f917f-295a-46af-8d2c-c18c152b9986-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:22 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD" returned: 0 in 0.758s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 was qcow2, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:34:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:22 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:34:22 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:24 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-8e40c3e6-3abe-4dd9-ba85-76ea690efd53 req-85563a7d-4ac5-41c6-a07e-0b650d6f4774 tempest-TestInstancesWithCinderVolumes-1460434 None] Terminate volume connection completed successfully. Jul 05 17:34:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-8e40c3e6-3abe-4dd9-ba85-76ea690efd53 req-85563a7d-4ac5-41c6-a07e-0b650d6f4774 tempest-TestInstancesWithCinderVolumes-1460434 None] Deleting attachment 2ef00d50-783c-4973-8a87-d0d049ec5ff0. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:34:24 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 0 in 1.829s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:24 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4_16u4_o54devstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:34:24 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Converted 112.00 MB image at 61.20 MB/s Jul 05 17:34:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:24 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf 1G Jul 05 17:34:24 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:25 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf 1G" returned: 0 in 0.667s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:25 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[021a6016-ea78-45f0-a4b2-3daa3ca4bd7d]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:25 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:34:25 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "cinder-81e9d416-dac4-431f-b685-0c125e440120-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-81e9d416-dac4-431f-b685-0c125e440120-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=101,cinder:UPDATE=130,cinder:INSERT=32,cinder:DELETE=10 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "cinder-quobyte-81e9d416-dac4-431f-b685-0c125e440120" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-quobyte-81e9d416-dac4-431f-b685-0c125e440120" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[37700782-1d2d-477c-893f-a24451968144]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:26 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 0 in 0.806s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:26 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 Jul 05 17:34:26 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:26 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:34:26 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:26 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120" returned: 0 in 0.826s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:26 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120 Jul 05 17:34:26 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:26 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 1 in 0.833s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Downloaded image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}])) to volume 215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Temporary image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 for user 0d1540355eb64c43b086f5b5fe2d1ab2 is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Marking volume 215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Copying metadata from image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 to 215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Creating volume glance metadata for volume 215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf backed by image ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e722ea-4a1e-4a0a-a4bd-58b03538a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf', 'volume_size': 1, 'image_id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d8084545d5b4231977162f4daac3464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4', 'created_at': datetime.datetime(2026, 7, 5, 15, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 11, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae09b7c9-2efc-42c8-9aef-7f13c42ca3f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33b0c88-0b0a-4959-9159-74faae779fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:34:27 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Volume volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf (215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf): created successfully Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33b0c88-0b0a-4959-9159-74faae779fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Flow 'volume_create_manager' (a91007b9-b02e-41cb-a5d9-7ba23fa3b1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:34:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4160e8eb-d496-4e1d-8e88-ebafb8a7892f tempest-TestShelveInstance-548768772 None] Created volume successfully. Jul 05 17:34:27 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-81e9d416-dac4-431f-b685-0c125e440120" returned: 0 in 0.759s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-quobyte-81e9d416-dac4-431f-b685-0c125e440120" released by "delete_volume" :: held 1.641s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:27 devstack cinder-volume[86459]: WARNING cinder.quota [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2095782849-772911599 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2095782849-772911599, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:34:27 devstack cinder-volume[86459]: WARNING cinder.quota [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2095782849-772911599 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2095782849-772911599, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Created reservations ['a8f8cda3-e98a-422a-bce9-922891d817af', '45ba4748-a218-4f4a-b21d-90a3418e87ef', 'eb6eee26-42a6-416c-8874-16bebbc8e571', '11e1f501-1bb5-4458-8fb4-2602b7b8a663'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:27 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:27 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:28 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.733s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:28 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:28 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Deleted volume successfully. Jul 05 17:34:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-08519d05-0e0f-4a5e-aab4-2cd5b09cadc5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-81e9d416-dac4-431f-b685-0c125e440120-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-d2286353-164a-45f0-8feb-c98c22fc9241 req-2698ca68-ed8f-4596-9758-51d4c969f380 tempest-TestInstancesWithCinderVolumes-1460434 None] Terminate volume connection completed successfully. Jul 05 17:34:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-d2286353-164a-45f0-8feb-c98c22fc9241 req-2698ca68-ed8f-4596-9758-51d4c969f380 tempest-TestInstancesWithCinderVolumes-1460434 None] Deleting attachment 5a1363a8-c596-42f1-97f8-04e7d3de824b. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:34:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ebf352-aac2-4fc9-a1d8-b0828221f8df]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "cinder-f3987091-00d8-4d74-9b35-952f0dc028db-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:35 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:34:35 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-f3987091-00d8-4d74-9b35-952f0dc028db-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "cinder-quobyte-f3987091-00d8-4d74-9b35-952f0dc028db" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:34:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-quobyte-f3987091-00d8-4d74-9b35-952f0dc028db" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:34:36 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c468ba-54cd-474b-a5a5-9d20a34847da]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:34:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:36 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:34:36 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:36 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 0 in 0.846s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:36 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:34:36 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:36 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 0 in 0.780s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:36 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:34:36 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:37 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 1 in 0.763s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:34:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.670s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c2e90d1-904f-4887-a3a2-a89664a46842', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:34:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-e2dbab65-7316-442d-9431-c4ea30b38d26 req-d9e3b20d-7f7e-49f6-958b-a5cee9f00373 tempest-TestShelveInstance-548768772 None] attachment_update completed successfully. Jul 05 17:34:37 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 1 in 0.767s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:34:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:37 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db Jul 05 17:34:37 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:38 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f3987091-00d8-4d74-9b35-952f0dc028db" returned: 0 in 0.681s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-quobyte-f3987091-00d8-4d74-9b35-952f0dc028db" released by "delete_volume" :: held 2.303s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:38 devstack cinder-volume[86459]: WARNING cinder.quota [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1037116217-123709119 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1037116217-123709119, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:34:38 devstack cinder-volume[86459]: WARNING cinder.quota [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1037116217-123709119 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1037116217-123709119, it is now deprecated. Please use the default quota class for default quota. Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Created reservations ['2eef6298-fd7b-41bb-9271-11321f1de6f7', 'a7249662-db65-44b0-a12f-7271891126aa', '9739b7bf-102c-4e4e-b362-29d020fe68d4', 'a26d5426-01c9-482a-b5cc-38b9b94f048d'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:38 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:38 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:39 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.647s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:39 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:39 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Deleted volume successfully. Jul 05 17:34:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1ef23d8a-0d46-4909-b801-f668bb526bd5 tempest-TestInstancesWithCinderVolumes-1460434 None] Lock "cinder-f3987091-00d8-4d74-9b35-952f0dc028db-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:34:48 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=18,cinder:INSERT=13,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:34:49 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=33,cinder:INSERT=8,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:34:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:34:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:34:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:34:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:34:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:34:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:34:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:34:50 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:34:50 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:34:51 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jul 05 17:34:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.719s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:34:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:34:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:34:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:34:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Flow 'volume_create_manager' (abccfc0a-bd15-4c5d-8c3e-9d03581b8704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fe4fa8-5b52-422e-89da-735c6b08a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fe4fa8-5b52-422e-89da-735c6b08a214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-244523213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6bce0c-ce66-41b2-827c-72c2aea14989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666b566f3baa4e578240901b19dff2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:35:11Z,use_quota=True,user_id='561ac804eb444d71a9660342788fa905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b91bdc-c150-4a70-8894-de8136caeeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b91bdc-c150-4a70-8894-de8136caeeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7c3aed-885c-40db-9e08-670ce9fbf3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7c3aed-885c-40db-9e08-670ce9fbf3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6bce0c-ce66-41b2-827c-72c2aea14989', 'volume_name': 'volume-3a6bce0c-ce66-41b2-827c-72c2aea14989', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4071a7-f8c8-474b-8518-bfa966e9ce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4071a7-f8c8-474b-8518-bfa966e9ce57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6fe2a0-0c4b-4aeb-a280-e2b9055d5278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:35:11 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Volume 3a6bce0c-ce66-41b2-827c-72c2aea14989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6bce0c-ce66-41b2-827c-72c2aea14989', 'volume_size': 1} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-244523213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6bce0c-ce66-41b2-827c-72c2aea14989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666b566f3baa4e578240901b19dff2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:35:11Z,use_quota=True,user_id='561ac804eb444d71a9660342788fa905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Creating volume 3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:35:11 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:35:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:35:11 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 1073741824 Jul 05 17:35:11 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:35:12 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jul 05 17:35:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 1073741824" returned: 0 in 0.939s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:35:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:35:12 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 Jul 05 17:35:12 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:35:13 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 05 17:35:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989" returned: 0 in 0.668s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:35:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:35:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:35:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6fe2a0-0c4b-4aeb-a280-e2b9055d5278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6bce0c-ce66-41b2-827c-72c2aea14989', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:35:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e28fd1f-5c29-41e1-8c7c-5e090ca2613e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:35:13 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Volume volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 (3a6bce0c-ce66-41b2-827c-72c2aea14989): created successfully Jul 05 17:35:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e28fd1f-5c29-41e1-8c7c-5e090ca2613e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:35:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Flow 'volume_create_manager' (abccfc0a-bd15-4c5d-8c3e-9d03581b8704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:35:13 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2042f480-0f42-4cbd-91aa-f410fda9cdea tempest-TestStampPattern-181639049 None] Created volume successfully. Jul 05 17:35:15 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-1c719f8e-4c78-438a-8334-5b12b4af5e9e req-6bbcbae6-e8a2-4525-9b89-02b10b899928 tempest-TestShelveInstance-548768772 None] Terminate volume connection completed successfully. Jul 05 17:35:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-1c719f8e-4c78-438a-8334-5b12b4af5e9e req-6bbcbae6-e8a2-4525-9b89-02b10b899928 tempest-TestShelveInstance-548768772 None] Deleting attachment 9c2e90d1-904f-4887-a3a2-a89664a46842. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:35:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:35:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:35:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8ce1b6-c363-4f1b-a139-21e1c5d7a144]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:35:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:35:20 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:35:20 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:35:21 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 05 17:35:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 0 in 0.750s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:35:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:35:21 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:35:21 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:35:22 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jul 05 17:35:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 1 in 0.936s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:35:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:35:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.724s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:35:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfff8693-6b04-41dc-b1d6-5f5ffeec3adb', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:35:22 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-f0d4f3b7-1426-49b9-8bd3-c40cc7a84448 req-4c54ef45-1142-4ea7-928b-aacbebec3afb tempest-TestShelveInstance-548768772 None] attachment_update completed successfully. Jul 05 17:35:32 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:35:32 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:INSERT=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:35:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:35:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:35:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:35:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-36c1b985-eec7-4546-a558-90e5d06994d5 req-1ecde573-20b9-4d5c-a6aa-177eece19c9a tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:35:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-36c1b985-eec7-4546-a558-90e5d06994d5 req-1ecde573-20b9-4d5c-a6aa-177eece19c9a tempest-TestStampPattern-181639049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:35:53 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f833cdf-8941-4f74-b625-9f4951522bf6]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:35:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-36c1b985-eec7-4546-a558-90e5d06994d5 req-1ecde573-20b9-4d5c-a6aa-177eece19c9a tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:35:53 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 Jul 05 17:35:53 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:35:54 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jul 05 17:35:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-36c1b985-eec7-4546-a558-90e5d06994d5 req-1ecde573-20b9-4d5c-a6aa-177eece19c9a tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989" returned: 0 in 0.732s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:35:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-36c1b985-eec7-4546-a558-90e5d06994d5 req-1ecde573-20b9-4d5c-a6aa-177eece19c9a tempest-TestStampPattern-181639049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.749s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:35:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-36c1b985-eec7-4546-a558-90e5d06994d5 req-1ecde573-20b9-4d5c-a6aa-177eece19c9a tempest-TestStampPattern-181639049 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-3a6bce0c-ce66-41b2-827c-72c2aea14989', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91a2cace-d922-42f6-b99e-dfcbd51c7bb2', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:35:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-36c1b985-eec7-4546-a558-90e5d06994d5 req-1ecde573-20b9-4d5c-a6aa-177eece19c9a tempest-TestStampPattern-181639049 None] attachment_update completed successfully. Jul 05 17:36:02 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-dae4ab7b-2bcc-4ba7-91ce-654eadcb7371 req-ba03bd8d-27d5-4a69-9f88-197c4bbc09b9 tempest-TestStampPattern-181639049 None] Terminate volume connection completed successfully. Jul 05 17:36:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-dae4ab7b-2bcc-4ba7-91ce-654eadcb7371 req-ba03bd8d-27d5-4a69-9f88-197c4bbc09b9 tempest-TestStampPattern-181639049 None] Deleting attachment 91a2cace-d922-42f6-b99e-dfcbd51c7bb2. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:36:04 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:36:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Creating offline snapshot 8f98e5d7-cc53-4bb8-869e-1e4bda66e55f of volume 3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:36:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec9f2d7-8469-42a5-81e2-4f5166e4a547]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:04 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 Jul 05 17:36:04 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:05 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989" returned: 0 in 0.739s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:05 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f 1G Jul 05 17:36:05 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:05 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f 1G" returned: 0 in 0.751s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:05 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f Jul 05 17:36:05 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:06 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" returned: 0 in 0.681s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:06 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f is being set with open permissions: ugo+rw Jul 05 17:36:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:06 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f Jul 05 17:36:06 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:07 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" returned: 0 in 0.632s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:07 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.info Jul 05 17:36:07 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:07 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.info" returned: 0 in 0.634s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:07 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.info is being set with open permissions: ugo+rw Jul 05 17:36:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:07 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.info Jul 05 17:36:07 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:08 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.info" returned: 0 in 0.630s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.184s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:08 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-de35e99c-2880-4224-a934-2cddd00570bc tempest-TestStampPattern-181639049 None] Create snapshot completed successfully Jul 05 17:36:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-df846ae9-72ac-4584-9dd4-272ef427318c req-84a5a1aa-cb3f-4efa-a190-1ddb1ee38a9f tempest-TestShelveInstance-548768772 None] Terminate volume connection completed successfully. Jul 05 17:36:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-df846ae9-72ac-4584-9dd4-272ef427318c req-84a5a1aa-cb3f-4efa-a190-1ddb1ee38a9f tempest-TestShelveInstance-548768772 None] Deleting attachment dfff8693-6b04-41dc-b1d6-5f5ffeec3adb. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:36:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Acquiring lock "cinder-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Lock "cinder-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Acquiring lock "cinder-quobyte-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Lock "cinder-quobyte-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:16 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad574839-564f-44af-9204-5930a19eb3df]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:16 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:36:16 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:17 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 0 in 0.795s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:17 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:36:17 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:18 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 1 in 0.796s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:36:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:18 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf Jul 05 17:36:18 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:19 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" returned: 0 in 0.720s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Lock "cinder-quobyte-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf" released by "delete_volume" :: held 2.383s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Flow 'volume_create_manager' (96e60529-8428-4c34-985f-ecfdb7025b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c29601-a9c4-4cfb-9f86-174085e45263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c29601-a9c4-4cfb-9f86-174085e45263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-586390962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d205f83-9609-4ed1-b580-5c775551d9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666b566f3baa4e578240901b19dff2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8f98e5d7-cc53-4bb8-869e-1e4bda66e55f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:36:19Z,use_quota=True,user_id='561ac804eb444d71a9660342788fa905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad512058-02bd-4821-bf09-2f19f43b88d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad512058-02bd-4821-bf09-2f19f43b88d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77506eb7-63ee-4353-86fe-103476a0cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77506eb7-63ee-4353-86fe-103476a0cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d205f83-9609-4ed1-b580-5c775551d9ec', 'volume_name': 'volume-2d205f83-9609-4ed1-b580-5c775551d9ec', 'volume_size': 1, 'snapshot_id': '8f98e5d7-cc53-4bb8-869e-1e4bda66e55f'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33667e83-33f8-4cb1-8e1c-b2c88a3302a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33667e83-33f8-4cb1-8e1c-b2c88a3302a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4173a17a-75da-410e-9956-88c1bbf6a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:19 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Volume 2d205f83-9609-4ed1-b580-5c775551d9ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d205f83-9609-4ed1-b580-5c775551d9ec', 'volume_size': 1, 'snapshot_id': '8f98e5d7-cc53-4bb8-869e-1e4bda66e55f'} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-quobyte-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f-2d205f83-9609-4ed1-b580-5c775551d9ec" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.quota [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Created reservations ['acfb6570-733a-4bee-8b36-0281c947bc2d', 'ae95a316-0051-4817-9d37-1b377d16aedd', 'c7badba0-1533-492f-8221-a164e0d51e76', 'f921d911-afa1-4b44-88d2-7c2cb3fe1d4a'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f-2d205f83-9609-4ed1-b580-5c775551d9ec" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Creating volume 2d205f83-9609-4ed1-b580-5c775551d9ec from snapshot 8f98e5d7-cc53-4bb8-869e-1e4bda66e55f {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-quobyte-2d205f83-9609-4ed1-b580-5c775551d9ec" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-2d205f83-9609-4ed1-b580-5c775551d9ec" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] snapshot: 8f98e5d7-cc53-4bb8-869e-1e4bda66e55f, volume: 2d205f83-9609-4ed1-b580-5c775551d9ec, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d33995-fb24-4e51-9780-15e337a25bca]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:19 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:36:19 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:19 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f Jul 05 17:36:19 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:20 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.946s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG cinder.manager [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:36:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Deleted volume successfully. Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [req-df846ae9-72ac-4584-9dd4-272ef427318c req-2c63dfd5-96fc-4e16-92d6-4e806c25b658 tempest-TestShelveInstance-548768772 None] Lock "cinder-215c1648-2b75-4fb7-88ed-cbc6b5cdbfbf-delete_volume" released by "delete_volume" :: held 3.731s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:20 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" returned: 0 in 1.045s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a6bce0c-ce66-41b2-827c-72c2aea14989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf22ebe-e17b-49c6-8937-58bf9fde57ab]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:20 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 Jul 05 17:36:20 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:21 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989" returned: 0 in 0.846s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:21 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:36:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:21 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec Jul 05 17:36:21 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec" returned: 0 in 5.792s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[439da904-dcf2-4c8c-b02a-4add39dd613d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:27 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 Jul 05 17:36:27 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:28 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989" returned: 0 in 1.297s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:28 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:36:28 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Converted 1024.00 MB image at 176.76 MB/s Jul 05 17:36:28 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec is being set with open permissions: ugo+rw Jul 05 17:36:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:28 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec Jul 05 17:36:28 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:29 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec" returned: 0 in 0.967s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-2d205f83-9609-4ed1-b580-5c775551d9ec" released by "_copy_volume_from_snapshot" :: held 10.072s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f-2d205f83-9609-4ed1-b580-5c775551d9ec" released by "_create_volume_from_snapshot" :: held 10.116s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.146s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4173a17a-75da-410e-9956-88c1bbf6a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d205f83-9609-4ed1-b580-5c775551d9ec', 'volume_size': 1, 'snapshot_id': '8f98e5d7-cc53-4bb8-869e-1e4bda66e55f'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f878dfc-6769-4bfa-b495-fce363440bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:29 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Volume volume-2d205f83-9609-4ed1-b580-5c775551d9ec (2d205f83-9609-4ed1-b580-5c775551d9ec): created successfully Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f878dfc-6769-4bfa-b495-fce363440bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Flow 'volume_create_manager' (96e60529-8428-4c34-985f-ecfdb7025b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:36:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-31a6c332-7299-487c-8d88-8a486c6aead0 tempest-TestStampPattern-181639049 None] Created volume successfully. Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Flow 'volume_create_manager' (9fddabf1-9b81-491a-904c-76b2c847d65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25449cba-1b7b-4159-bfd1-c0dc1c3c4714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25449cba-1b7b-4159-bfd1-c0dc1c3c4714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1813829203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddc0a60-e37c-4cad-a99c-eb73abc1bea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50259f298cf424cade6f7688cb89a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:36:35Z,use_quota=True,user_id='f8f2f3dad4bf422eb3793ce10df507b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301c82ae-028b-44dc-9985-7bb779be34f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301c82ae-028b-44dc-9985-7bb779be34f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e997dd-3749-446a-9cb4-9dfb4f58e110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e997dd-3749-446a-9cb4-9dfb4f58e110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddc0a60-e37c-4cad-a99c-eb73abc1bea4', 'volume_name': 'volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5ff1cf-46d4-49b1-a058-0102fdb158c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5ff1cf-46d4-49b1-a058-0102fdb158c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c35795-f1f5-47f8-b55a-559c75cd3a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:35 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Volume 4ddc0a60-e37c-4cad-a99c-eb73abc1bea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4', 'volume_size': 1} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1813829203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddc0a60-e37c-4cad-a99c-eb73abc1bea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50259f298cf424cade6f7688cb89a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:36:35Z,use_quota=True,user_id='f8f2f3dad4bf422eb3793ce10df507b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Creating volume 4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:36:35 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:36:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:35 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 1073741824 Jul 05 17:36:35 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:36 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 1073741824" returned: 0 in 0.904s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:36 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 Jul 05 17:36:36 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:37 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" returned: 0 in 0.679s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c35795-f1f5-47f8-b55a-559c75cd3a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c289509c-0540-42a0-b89a-34ca66d02e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:37 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Volume volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 (4ddc0a60-e37c-4cad-a99c-eb73abc1bea4): created successfully Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c289509c-0540-42a0-b89a-34ca66d02e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Flow 'volume_create_manager' (9fddabf1-9b81-491a-904c-76b2c847d65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:36:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8239a359-645f-459f-af08-d8e7c2c3734b tempest-VolumeDependencyTests-2007240452 None] Created volume successfully. Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Creating offline snapshot 783a258e-3667-4103-ad3f-fc213c2e8ac7 of volume 4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf8010c-57d9-42f1-a6c9-459ee039db9f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:37 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 Jul 05 17:36:37 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:38 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" returned: 0 in 0.860s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:38 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 1G Jul 05 17:36:38 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:39 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 1G" returned: 0 in 0.881s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:39 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 Jul 05 17:36:39 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:40 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7" returned: 0 in 0.667s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:40 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 is being set with open permissions: ugo+rw Jul 05 17:36:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:40 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 Jul 05 17:36:40 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:40 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7" returned: 0 in 0.661s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:40 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.info Jul 05 17:36:40 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:41 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.info" returned: 0 in 0.652s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:41 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.info is being set with open permissions: ugo+rw Jul 05 17:36:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:41 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.info Jul 05 17:36:41 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:42 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.info" returned: 0 in 0.650s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.473s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c68ab4b8-e04e-449c-b9a1-cd34aced5135 tempest-VolumeDependencyTests-2007240452 None] Create snapshot completed successfully Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Flow 'volume_create_manager' (a206c96c-353c-423b-a537-cf9ecaf53f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d0726d-949e-458f-af6d-b97979779cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d0726d-949e-458f-af6d-b97979779cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-857309643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace96095-c4b3-4d01-83e7-febe9c4bdf1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50259f298cf424cade6f7688cb89a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=783a258e-3667-4103-ad3f-fc213c2e8ac7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:36:43Z,use_quota=True,user_id='f8f2f3dad4bf422eb3793ce10df507b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39fb284-cfd5-441c-a5b9-ddddc213502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39fb284-cfd5-441c-a5b9-ddddc213502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac1951c-831f-4249-acff-8e8e7aac7901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac1951c-831f-4249-acff-8e8e7aac7901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ace96095-c4b3-4d01-83e7-febe9c4bdf1e', 'volume_name': 'volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e', 'volume_size': 1, 'snapshot_id': '783a258e-3667-4103-ad3f-fc213c2e8ac7'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ed7cc3-73d1-44c5-871c-5a5adf427777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ed7cc3-73d1-44c5-871c-5a5adf427777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8df9a0-3ff5-416a-af3d-b6babd0593f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:43 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Volume ace96095-c4b3-4d01-83e7-febe9c4bdf1e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e', 'volume_size': 1, 'snapshot_id': '783a258e-3667-4103-ad3f-fc213c2e8ac7'} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-quobyte-783a258e-3667-4103-ad3f-fc213c2e8ac7-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-783a258e-3667-4103-ad3f-fc213c2e8ac7-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Creating volume ace96095-c4b3-4d01-83e7-febe9c4bdf1e from snapshot 783a258e-3667-4103-ad3f-fc213c2e8ac7 {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-quobyte-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] snapshot: 783a258e-3667-4103-ad3f-fc213c2e8ac7, volume: ace96095-c4b3-4d01-83e7-febe9c4bdf1e, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6569eb63-ef0b-4214-924e-35fb6134c57a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:43 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 Jul 05 17:36:43 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:44 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7" returned: 0 in 0.754s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:36:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:36:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:36:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a37d110-ed86-4e69-ae3b-9331e57a1b67]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:44 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 Jul 05 17:36:44 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:45 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" returned: 0 in 0.801s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:45 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:36:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:45 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e Jul 05 17:36:45 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:50 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" returned: 0 in 5.018s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ff5f1-bebf-4a5b-a3b7-31a8989f0694]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:50 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 Jul 05 17:36:50 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:50 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:36:50 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:51 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" returned: 0 in 0.958s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:36:51 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Converted 1024.00 MB image at 203.99 MB/s Jul 05 17:36:51 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e is being set with open permissions: ugo+rw Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:51 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e Jul 05 17:36:51 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:51 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.635s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:36:51 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" returned: 0 in 0.641s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" released by "_copy_volume_from_snapshot" :: held 8.260s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-783a258e-3667-4103-ad3f-fc213c2e8ac7-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" released by "_create_volume_from_snapshot" :: held 8.291s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.305s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8df9a0-3ff5-416a-af3d-b6babd0593f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e', 'volume_size': 1, 'snapshot_id': '783a258e-3667-4103-ad3f-fc213c2e8ac7'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4cf113-68e0-46c5-abd7-6c216e8a9bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:36:51 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Volume volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e (ace96095-c4b3-4d01-83e7-febe9c4bdf1e): created successfully Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4cf113-68e0-46c5-abd7-6c216e8a9bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:36:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Flow 'volume_create_manager' (a206c96c-353c-423b-a537-cf9ecaf53f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:36:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-72438057-1e13-47cb-93b2-58e32be4f882 tempest-VolumeDependencyTests-2007240452 None] Created volume successfully. Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-783a258e-3667-4103-ad3f-fc213c2e8ac7-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-783a258e-3667-4103-ad3f-fc213c2e8ac7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-quobyte-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-quobyte-783a258e-3667-4103-ad3f-fc213c2e8ac7" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-783a258e-3667-4103-ad3f-fc213c2e8ac7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Deleting offline snapshot 783a258e-3667-4103-ad3f-fc213c2e8ac7 of volume 4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] snapshot_file for this snap is: volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a3147f-1a56-49c3-9938-2d08adeb5293]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:52 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 Jul 05 17:36:52 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:53 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7" returned: 0 in 0.760s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:36:53 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5929f7db-b5c1-4658-a8b8-5c3e62663689]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:53 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 Jul 05 17:36:53 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:53 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" returned: 0 in 0.741s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:54 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 Jul 05 17:36:54 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:54 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7" returned: 0 in 0.702s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:54 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7 Jul 05 17:36:54 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:55 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4.783a258e-3667-4103-ad3f-fc213c2e8ac7" returned: 0 in 0.612s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=30,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-783a258e-3667-4103-ad3f-fc213c2e8ac7" released by "_delete_snapshot" :: held 2.910s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" released by "delete_snapshot" :: held 2.933s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Created reservations ['5020c06a-ac29-4b70-9184-bb9c7898d0f6', '136695a2-a6d5-410c-830b-5de71e4f8f55', '81b046a9-677b-4298-a40c-9f96ad52bd2f', '48bfab88-0fb4-44f4-bc38-8c09dc57cce5'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:36:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Delete snapshot completed successfully. Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c7732f95-de3b-49b4-af4b-f0b8297708a0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-783a258e-3667-4103-ad3f-fc213c2e8ac7-delete_snapshot" released by "delete_snapshot" :: held 3.073s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-quobyte-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d5c26a-977a-45a3-b86b-7d2b91bff4cf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:55 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 Jul 05 17:36:55 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:56 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" returned: 0 in 0.760s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:56 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4 Jul 05 17:36:56 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:57 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" returned: 0 in 0.632s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4" released by "delete_volume" :: held 1.449s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Created reservations ['ebf9b915-7191-4b2f-8e88-58836291e7a2', '3a659a88-37a4-42a3-8723-2ba7da07a588', '3eee710e-c7d9-4a53-8347-34ab8de0217c', '4353ad48-ec73-4ccb-8284-dc011282c001'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:57 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:36:57 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-ace96095-c4b3-4d01-83e7-febe9c4bdf1e-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-ace96095-c4b3-4d01-83e7-febe9c4bdf1e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:57 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.660s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:36:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Deleted volume successfully. Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "cinder-quobyte-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9f53ca2b-40c3-4a56-b362-839cf07ca94e tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-4ddc0a60-e37c-4cad-a99c-eb73abc1bea4-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b649643-7c2e-4571-b6a6-cd483301ec0c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:36:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:58 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e Jul 05 17:36:58 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:58 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" returned: 0 in 0.769s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:58 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e Jul 05 17:36:58 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:36:59 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" returned: 0 in 0.636s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-quobyte-ace96095-c4b3-4d01-83e7-febe9c4bdf1e" released by "delete_volume" :: held 1.446s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Created reservations ['e85cb68e-d17f-4356-a5ae-3b183670c36b', '6c65d003-47f3-40f5-b019-0f380a2ac653', '8043fb0d-f2d5-4236-bf8f-3b42c84351b8', '90ab6814-03c4-46cd-a55c-a949aa55980f'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:36:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:36:59 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:36:59 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:00 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.651s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:00 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:37:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Deleted volume successfully. Jul 05 17:37:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d351ee9d-fc49-4f75-a258-9dc5db93c5f0 tempest-VolumeDependencyTests-2007240452 None] Lock "cinder-ace96095-c4b3-4d01-83e7-febe9c4bdf1e-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:09 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=28,cinder:SELECT=29,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:37:10 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:37:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-393750eb-036f-4246-8242-2c3c2e9a7362 req-86bcac06-cda1-4dc2-b864-b9dcc8da5f0d tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-393750eb-036f-4246-8242-2c3c2e9a7362 req-86bcac06-cda1-4dc2-b864-b9dcc8da5f0d tempest-TestStampPattern-181639049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:19 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a07da3d-1cc6-4dde-a475-b1bb3a522a8b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-393750eb-036f-4246-8242-2c3c2e9a7362 req-86bcac06-cda1-4dc2-b864-b9dcc8da5f0d tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:19 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec Jul 05 17:37:19 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:20 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [req-393750eb-036f-4246-8242-2c3c2e9a7362 req-86bcac06-cda1-4dc2-b864-b9dcc8da5f0d tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec" returned: 0 in 0.881s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [req-393750eb-036f-4246-8242-2c3c2e9a7362 req-86bcac06-cda1-4dc2-b864-b9dcc8da5f0d tempest-TestStampPattern-181639049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.904s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-393750eb-036f-4246-8242-2c3c2e9a7362 req-86bcac06-cda1-4dc2-b864-b9dcc8da5f0d tempest-TestStampPattern-181639049 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e', 'name': 'volume-2d205f83-9609-4ed1-b580-5c775551d9ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b585900b-a2c0-48d1-9fca-8f6d191e03c0', 'enforce_multipath': True} {{(pid=86459) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 17:37:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-393750eb-036f-4246-8242-2c3c2e9a7362 req-86bcac06-cda1-4dc2-b864-b9dcc8da5f0d tempest-TestStampPattern-181639049 None] attachment_update completed successfully. Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Flow 'volume_create_manager' (4465e0c6-d9a3-4add-bb1e-acf793a39034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39aea66f-9601-400b-b8d8-459b87b39a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39aea66f-9601-400b-b8d8-459b87b39a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1894640467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb339620-c635-46ec-bcc7-68c3e2231263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36cd612892d146d49a959b790feab36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:37:23Z,use_quota=True,user_id='d75f14e0ec5b47baa08592940db2d15f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a02560a-8947-4377-bfe1-bbefcbb91e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a02560a-8947-4377-bfe1-bbefcbb91e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f9a183-7f06-47a5-aef2-68fb3ae96edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f9a183-7f06-47a5-aef2-68fb3ae96edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb339620-c635-46ec-bcc7-68c3e2231263', 'volume_name': 'volume-cb339620-c635-46ec-bcc7-68c3e2231263', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc393ae9-5e7b-446e-bc0e-6346d868e857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc393ae9-5e7b-446e-bc0e-6346d868e857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef8809d-a726-4fe4-9cfa-27dd0d32eb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:22 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Volume cb339620-c635-46ec-bcc7-68c3e2231263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb339620-c635-46ec-bcc7-68c3e2231263', 'volume_size': 1} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1894640467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb339620-c635-46ec-bcc7-68c3e2231263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36cd612892d146d49a959b790feab36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:37:23Z,use_quota=True,user_id='d75f14e0ec5b47baa08592940db2d15f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Creating volume cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:37:22 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:37:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:22 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 1073741824 Jul 05 17:37:22 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:23 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 1073741824" returned: 0 in 0.830s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:23 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 Jul 05 17:37:23 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:24 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263" returned: 0 in 0.629s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:37:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef8809d-a726-4fe4-9cfa-27dd0d32eb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb339620-c635-46ec-bcc7-68c3e2231263', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7157a6b-c75e-44e6-a4b5-6c46a8e9b4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:24 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Volume volume-cb339620-c635-46ec-bcc7-68c3e2231263 (cb339620-c635-46ec-bcc7-68c3e2231263): created successfully Jul 05 17:37:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7157a6b-c75e-44e6-a4b5-6c46a8e9b4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Flow 'volume_create_manager' (4465e0c6-d9a3-4add-bb1e-acf793a39034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:37:24 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ca8b1df0-0135-4701-b81f-9942198a1df6 tempest-SnapshotDependencyTests-1591822779 None] Created volume successfully. Jul 05 17:37:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Creating offline snapshot 6f72569e-5841-4826-ae4f-f339499831d6 of volume cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:37:25 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c685f16c-82f0-4efc-b2c8-00c8c5c64326]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:25 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 Jul 05 17:37:25 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:25 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263" returned: 0 in 0.745s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:25 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 1G Jul 05 17:37:25 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:26 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 1G" returned: 0 in 0.775s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb339620-c635-46ec-bcc7-68c3e2231263 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:26 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb339620-c635-46ec-bcc7-68c3e2231263 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 Jul 05 17:37:26 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:27 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb339620-c635-46ec-bcc7-68c3e2231263 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6" returned: 0 in 0.714s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:27 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 is being set with open permissions: ugo+rw Jul 05 17:37:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:27 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 Jul 05 17:37:27 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:28 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6" returned: 0 in 0.658s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:28 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.info Jul 05 17:37:28 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:28 devstack cinder-volume[86459]: INFO cinder.volume.manager [req-34dcbf73-64fe-42c5-82ed-75ae7d29ac58 req-be5d4e67-c6fe-46aa-940c-f51a03147074 tempest-TestStampPattern-181639049 None] Terminate volume connection completed successfully. Jul 05 17:37:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [req-34dcbf73-64fe-42c5-82ed-75ae7d29ac58 req-be5d4e67-c6fe-46aa-940c-f51a03147074 tempest-TestStampPattern-181639049 None] Deleting attachment b585900b-a2c0-48d1-9fca-8f6d191e03c0. {{(pid=86459) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 17:37:28 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.info" returned: 0 in 0.715s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:28 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.info is being set with open permissions: ugo+rw Jul 05 17:37:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:28 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.info Jul 05 17:37:28 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:29 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.info" returned: 0 in 0.675s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.375s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d9860ff4-a7ba-45fc-b17d-f9b70ca13633 tempest-SnapshotDependencyTests-1591822779 None] Create snapshot completed successfully Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Flow 'volume_create_manager' (64b0d773-8e05-4aaa-b83c-7a9526c8d0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9193b2-e927-4632-b48e-4cff6102dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9193b2-e927-4632-b48e-4cff6102dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f47574d-c059-4ac6-bf6a-af57a940697f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36cd612892d146d49a959b790feab36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f72569e-5841-4826-ae4f-f339499831d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:37:31Z,use_quota=True,user_id='d75f14e0ec5b47baa08592940db2d15f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3709b33d-a6ac-41a7-8070-7b3542fbf448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3709b33d-a6ac-41a7-8070-7b3542fbf448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fd6a86-00c6-4d62-b9b8-f8692917fd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fd6a86-00c6-4d62-b9b8-f8692917fd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f47574d-c059-4ac6-bf6a-af57a940697f', 'volume_name': 'volume-5f47574d-c059-4ac6-bf6a-af57a940697f', 'volume_size': 1, 'snapshot_id': '6f72569e-5841-4826-ae4f-f339499831d6'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76397884-9d80-440f-8bad-34c859e26719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76397884-9d80-440f-8bad-34c859e26719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f02a946-d561-4bf6-aae3-fe873eddc3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:31 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Volume 5f47574d-c059-4ac6-bf6a-af57a940697f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f47574d-c059-4ac6-bf6a-af57a940697f', 'volume_size': 1, 'snapshot_id': '6f72569e-5841-4826-ae4f-f339499831d6'} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-quobyte-6f72569e-5841-4826-ae4f-f339499831d6-5f47574d-c059-4ac6-bf6a-af57a940697f" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-6f72569e-5841-4826-ae4f-f339499831d6-5f47574d-c059-4ac6-bf6a-af57a940697f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Creating volume 5f47574d-c059-4ac6-bf6a-af57a940697f from snapshot 6f72569e-5841-4826-ae4f-f339499831d6 {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-quobyte-5f47574d-c059-4ac6-bf6a-af57a940697f" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-5f47574d-c059-4ac6-bf6a-af57a940697f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] snapshot: 6f72569e-5841-4826-ae4f-f339499831d6, volume: 5f47574d-c059-4ac6-bf6a-af57a940697f, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b744da-f138-419d-ae0c-f10bac9d8660]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:31 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 Jul 05 17:37:31 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:32 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6" returned: 0 in 0.788s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb339620-c635-46ec-bcc7-68c3e2231263(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42de2b4-cc25-4e43-b1eb-65ddd2cc2f2c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:32 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 Jul 05 17:37:32 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:32 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263" returned: 0 in 0.787s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:37:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:32 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f Jul 05 17:37:32 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:38 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f" returned: 0 in 5.274s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[2607d813-d9a3-46d7-87bb-b606fabc48b5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:38 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 Jul 05 17:37:38 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-2d205f83-9609-4ed1-b580-5c775551d9ec-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Lock "cinder-2d205f83-9609-4ed1-b580-5c775551d9ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:39 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263" returned: 0 in 0.942s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:37:39 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Converted 1024.00 MB image at 194.10 MB/s Jul 05 17:37:39 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f is being set with open permissions: ugo+rw Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:39 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f Jul 05 17:37:39 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-quobyte-2d205f83-9609-4ed1-b580-5c775551d9ec" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-2d205f83-9609-4ed1-b580-5c775551d9ec" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[067ee693-1d63-4238-a968-116c6e0e475a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:39 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec Jul 05 17:37:39 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:39 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f" returned: 0 in 0.667s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-5f47574d-c059-4ac6-bf6a-af57a940697f" released by "_copy_volume_from_snapshot" :: held 8.554s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-6f72569e-5841-4826-ae4f-f339499831d6-5f47574d-c059-4ac6-bf6a-af57a940697f" released by "_create_volume_from_snapshot" :: held 8.591s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.608s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f02a946-d561-4bf6-aae3-fe873eddc3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f47574d-c059-4ac6-bf6a-af57a940697f', 'volume_size': 1, 'snapshot_id': '6f72569e-5841-4826-ae4f-f339499831d6'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63845459-1aa1-4189-acf2-64216c576f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:37:39 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Volume volume-5f47574d-c059-4ac6-bf6a-af57a940697f (5f47574d-c059-4ac6-bf6a-af57a940697f): created successfully Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63845459-1aa1-4189-acf2-64216c576f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Flow 'volume_create_manager' (64b0d773-8e05-4aaa-b83c-7a9526c8d0bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:37:39 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5352db61-e515-4c81-bf16-becac95ab1ce tempest-SnapshotDependencyTests-1591822779 None] Created volume successfully. Jul 05 17:37:39 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec" returned: 0 in 0.819s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:39 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec Jul 05 17:37:39 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:40 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2d205f83-9609-4ed1-b580-5c775551d9ec" returned: 0 in 0.643s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-2d205f83-9609-4ed1-b580-5c775551d9ec" released by "delete_volume" :: held 1.505s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Created reservations ['0da3c6bb-1063-4bef-9d84-959a5a97b47b', 'c6dbf9c7-3a1d-4d56-a9bc-5451a411a97e', '98204128-bcb1-4d1d-8086-883eee8fd707', '33403682-204f-4bda-b4c2-f45373bcd26f'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:40 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:37:40 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-6f72569e-5841-4826-ae4f-f339499831d6-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-6f72569e-5841-4826-ae4f-f339499831d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-quobyte-cb339620-c635-46ec-bcc7-68c3e2231263" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-cb339620-c635-46ec-bcc7-68c3e2231263" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-quobyte-6f72569e-5841-4826-ae4f-f339499831d6" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-6f72569e-5841-4826-ae4f-f339499831d6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Deleting offline snapshot 6f72569e-5841-4826-ae4f-f339499831d6 of volume cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] snapshot_file for this snap is: volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[052d1900-3434-4da3-bec7-67d007bccf30]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:41 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 Jul 05 17:37:41 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:41 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.656s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:37:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Deleted volume successfully. Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-1bf7821c-53a9-46c5-930d-b379074b505e tempest-TestStampPattern-181639049 None] Lock "cinder-2d205f83-9609-4ed1-b580-5c775551d9ec-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Lock "cinder-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-quobyte-3a6bce0c-ce66-41b2-827c-72c2aea14989" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-3a6bce0c-ce66-41b2-827c-72c2aea14989" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-quobyte-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Deleting offline snapshot 8f98e5d7-cc53-4bb8-869e-1e4bda66e55f of volume 3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] snapshot_file for this snap is: volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[658ccbdf-7d47-4bc5-915b-ae9888f4657b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:41 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f Jul 05 17:37:41 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:41 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6" returned: 0 in 0.804s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb339620-c635-46ec-bcc7-68c3e2231263(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2f4e9e-5abc-4603-9849-3ac16af57311]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:42 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 Jul 05 17:37:42 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:42 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" returned: 0 in 0.749s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a6bce0c-ce66-41b2-827c-72c2aea14989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:37:42 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba144e49-8b04-426c-a429-824cc4b3083c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:42 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 Jul 05 17:37:42 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:42 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263" returned: 0 in 0.805s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:42 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 Jul 05 17:37:42 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:43 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989" returned: 0 in 0.747s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:43 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f Jul 05 17:37:43 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:43 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6" returned: 0 in 0.754s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:43 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6 Jul 05 17:37:43 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:43 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" returned: 0 in 0.746s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:43 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f Jul 05 17:37:43 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:44 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263.6f72569e-5841-4826-ae4f-f339499831d6" returned: 0 in 0.655s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-6f72569e-5841-4826-ae4f-f339499831d6" released by "_delete_snapshot" :: held 3.119s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-cb339620-c635-46ec-bcc7-68c3e2231263" released by "delete_snapshot" :: held 3.145s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Created reservations ['14b28a85-1221-4303-af9d-263c40895e04', 'c54f0fc0-e886-4226-bbd4-3d14572846d4', '48cf72a7-d37c-4bb6-9853-777abaf447b3', '69199869-c2ce-428a-ac0a-020d55c48657'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:37:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Delete snapshot completed successfully. Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f4033eea-c03d-46eb-b859-46b6a1c01705 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-6f72569e-5841-4826-ae4f-f339499831d6-delete_snapshot" released by "delete_snapshot" :: held 3.280s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:44 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989.8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" returned: 0 in 0.646s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f" released by "_delete_snapshot" :: held 2.979s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-3a6bce0c-ce66-41b2-827c-72c2aea14989" released by "delete_snapshot" :: held 3.003s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Created reservations ['93bc7dc6-e937-4787-ae93-9fbb5b717ab6', '95ae440e-9952-4488-a7c0-f0a84c8a6fb6', '380acb53-09d1-43c5-af07-9d3d1035a478', '09b8ac01-9a7e-4cb2-92b4-512c740829a6'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:37:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Delete snapshot completed successfully. Jul 05 17:37:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-cf35bc4d-eb0d-4d48-840a-0e48578ace11 tempest-TestStampPattern-181639049 None] Lock "cinder-8f98e5d7-cc53-4bb8-869e-1e4bda66e55f-delete_snapshot" released by "delete_snapshot" :: held 3.142s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-cb339620-c635-46ec-bcc7-68c3e2231263-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-cb339620-c635-46ec-bcc7-68c3e2231263-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-quobyte-cb339620-c635-46ec-bcc7-68c3e2231263" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-cb339620-c635-46ec-bcc7-68c3e2231263" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:45 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[74136ce6-e5fd-4077-bf86-b931fb5d871a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:45 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 Jul 05 17:37:45 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:46 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:46 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263 Jul 05 17:37:46 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:46 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cb339620-c635-46ec-bcc7-68c3e2231263" returned: 0 in 0.635s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-cb339620-c635-46ec-bcc7-68c3e2231263" released by "delete_volume" :: held 1.497s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:46 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Created reservations ['aab92eca-191f-4268-a6f2-27747cacb544', '76758424-2999-4495-987f-15fb8650f027', '924ec535-988e-4caa-8daa-29b723078d70', '00515044-dc11-4ef6-9ff9-6a7cb53033c7'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:47 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:37:47 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-5f47574d-c059-4ac6-bf6a-af57a940697f-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-5f47574d-c059-4ac6-bf6a-af57a940697f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "cinder-quobyte-5f47574d-c059-4ac6-bf6a-af57a940697f" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-5f47574d-c059-4ac6-bf6a-af57a940697f" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b789b4f0-8f79-4b49-8b65-2f4297f6f38a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:47 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.851s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:37:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Deleted volume successfully. Jul 05 17:37:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e3cd4bff-02ab-45b7-ada6-cc3527c8edb2 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-cb339620-c635-46ec-bcc7-68c3e2231263-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:47 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f Jul 05 17:37:47 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:48 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f" returned: 0 in 0.878s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:48 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f Jul 05 17:37:48 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:49 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f47574d-c059-4ac6-bf6a-af57a940697f" returned: 0 in 0.651s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-quobyte-5f47574d-c059-4ac6-bf6a-af57a940697f" released by "delete_volume" :: held 1.575s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Created reservations ['80a5f333-7c37-4289-922f-cb51ffbe4b3f', 'c590f27c-aec6-40ba-8f48-65d5eb963f58', '9338590b-b2a6-489b-8644-265f347442cf', '439b9068-602f-47ad-818d-620da63e49f7'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:49 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:37:49 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:50 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.683s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:37:50 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Deleted volume successfully. Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9a49263c-4f4a-4038-8693-37d85a4c9780 tempest-SnapshotDependencyTests-1591822779 None] Lock "cinder-5f47574d-c059-4ac6-bf6a-af57a940697f-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:50 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:37:50 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:51 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.668s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:37:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:37:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:37:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:37:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-3a6bce0c-ce66-41b2-827c-72c2aea14989-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Lock "cinder-3a6bce0c-ce66-41b2-827c-72c2aea14989-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Acquiring lock "cinder-quobyte-3a6bce0c-ce66-41b2-827c-72c2aea14989" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:37:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-3a6bce0c-ce66-41b2-827c-72c2aea14989" acquired by "delete_volume" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:37:52 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd728754-f82a-44c7-aa9c-d676f5ea2fae]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:37:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:52 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 Jul 05 17:37:52 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:52 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989" returned: 0 in 0.870s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:52 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989 Jul 05 17:37:52 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:53 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-3a6bce0c-ce66-41b2-827c-72c2aea14989" returned: 0 in 0.725s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Lock "cinder-quobyte-3a6bce0c-ce66-41b2-827c-72c2aea14989" released by "delete_volume" :: held 1.667s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Created reservations ['44c80a55-c6a6-4a1f-8ab0-1fdfc3b3d958', 'b541004e-84a1-4a44-889f-0b381f0dc05e', '60337609-ce7a-43a4-a4b2-cda5f19465bb', 'cf0758b4-d53b-4150-a54e-4219e184ae14'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:37:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:37:53 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:37:53 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:37:54 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 05 17:37:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.762s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:37:54 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:37:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Deleted volume successfully. Jul 05 17:37:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-37ddcd3f-2f8f-4ade-8657-092cadc54670 tempest-TestStampPattern-181639049 None] Lock "cinder-3a6bce0c-ce66-41b2-827c-72c2aea14989-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:03 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=48,cinder:UPDATE=50,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=43,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (f2cfa6d4-34e8-4185-bc8d-a1e366cd80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d699ab3-a599-4f83-ad70-0f8f4b2e781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d699ab3-a599-4f83-ad70-0f8f4b2e781b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976305037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa36c54-28cc-481f-8734-73025a3bdb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:05Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff541ca-b9d1-49f4-9d89-431b7456c63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff541ca-b9d1-49f4-9d89-431b7456c63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679bfed0-6ce7-43f9-ac0f-293d6e78e87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679bfed0-6ce7-43f9-ac0f-293d6e78e87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa36c54-28cc-481f-8734-73025a3bdb57', 'volume_name': 'volume-6fa36c54-28cc-481f-8734-73025a3bdb57', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f02f00e-ff1c-45da-80cf-e4766c43280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f02f00e-ff1c-45da-80cf-e4766c43280b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b899b424-30d9-49ea-8a2b-e2105b86c4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:04 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume 6fa36c54-28cc-481f-8734-73025a3bdb57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa36c54-28cc-481f-8734-73025a3bdb57', 'volume_size': 1} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976305037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa36c54-28cc-481f-8734-73025a3bdb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:05Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Creating volume 6fa36c54-28cc-481f-8734-73025a3bdb57 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:04 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:05 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 1073741824 Jul 05 17:38:05 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:05 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 1073741824" returned: 0 in 0.789s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:05 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 Jul 05 17:38:05 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:06 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57" returned: 0 in 0.647s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b899b424-30d9-49ea-8a2b-e2105b86c4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa36c54-28cc-481f-8734-73025a3bdb57', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a742f5-4fde-44fe-b35e-347f2ff806bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:06 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume volume-6fa36c54-28cc-481f-8734-73025a3bdb57 (6fa36c54-28cc-481f-8734-73025a3bdb57): created successfully Jul 05 17:38:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a742f5-4fde-44fe-b35e-347f2ff806bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (f2cfa6d4-34e8-4185-bc8d-a1e366cd80a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ad710c99-5dd8-4198-a3ff-89b8cf13f613 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created volume successfully. Jul 05 17:38:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Creating offline snapshot 170123cf-7a38-41e5-b99c-d7f5e408814c of volume 6fa36c54-28cc-481f-8734-73025a3bdb57 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:38:07 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153de33-4acd-4cf8-ba46-b8adc914f42f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:07 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 Jul 05 17:38:07 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:07 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57" returned: 0 in 0.723s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:07 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c 1G Jul 05 17:38:07 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:08 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c 1G" returned: 0 in 0.764s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa36c54-28cc-481f-8734-73025a3bdb57 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:08 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa36c54-28cc-481f-8734-73025a3bdb57 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c Jul 05 17:38:08 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:09 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa36c54-28cc-481f-8734-73025a3bdb57 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c" returned: 0 in 0.674s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:09 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c is being set with open permissions: ugo+rw Jul 05 17:38:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:09 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c Jul 05 17:38:09 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:09 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c" returned: 0 in 0.645s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:10 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.info Jul 05 17:38:10 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:10 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.info" returned: 0 in 0.626s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:10 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.info is being set with open permissions: ugo+rw Jul 05 17:38:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:10 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.info Jul 05 17:38:10 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:11 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.info" returned: 0 in 0.637s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.149s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-93e3f2bb-6220-48f2-a6b2-f90784a56c92 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Create snapshot completed successfully Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (5da9d2c1-be20-4b28-af0e-c6fcddb54b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df04ddd3-0373-497b-968a-8e0ecfafabd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df04ddd3-0373-497b-968a-8e0ecfafabd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037207391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d464e15-ba39-4dd3-b5a8-69dd3356f045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:13Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56533fe-0755-4d67-94ac-b6b2e24bf991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56533fe-0755-4d67-94ac-b6b2e24bf991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5051ac65-7436-452e-bb7d-a05bad8587d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5051ac65-7436-452e-bb7d-a05bad8587d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d464e15-ba39-4dd3-b5a8-69dd3356f045', 'volume_name': 'volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baaac5b-fe9d-4df1-a5fd-66611a135c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baaac5b-fe9d-4df1-a5fd-66611a135c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81c873d-2491-4940-aafd-0a6a52c2100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:12 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume 4d464e15-ba39-4dd3-b5a8-69dd3356f045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045', 'volume_size': 1} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037207391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d464e15-ba39-4dd3-b5a8-69dd3356f045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:13Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Creating volume 4d464e15-ba39-4dd3-b5a8-69dd3356f045 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:12 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:12 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 1073741824 Jul 05 17:38:12 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (b6e8459f-f356-4c34-9005-447240b925bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4370d504-7b7a-422d-92a7-d7ce4d26e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4370d504-7b7a-422d-92a7-d7ce4d26e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404717602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7e447d-3775-40ae-83db-24663df8022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:13Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76de94e0-5691-43d8-a798-8d4030413182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76de94e0-5691-43d8-a798-8d4030413182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db14de84-34cf-4f21-a0d6-4a82eb2c141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db14de84-34cf-4f21-a0d6-4a82eb2c141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7e447d-3775-40ae-83db-24663df8022c', 'volume_name': 'volume-5f7e447d-3775-40ae-83db-24663df8022c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe8505d-98a1-4238-8141-674d2e08fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe8505d-98a1-4238-8141-674d2e08fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3207c6ff-3d69-4ee8-a226-0555403ab5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume 5f7e447d-3775-40ae-83db-24663df8022c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7e447d-3775-40ae-83db-24663df8022c', 'volume_size': 1} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (a17ff267-f8ed-4451-b2da-a9c1acbbe890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39f302c-0812-4b3d-be58-83cf86abb58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39f302c-0812-4b3d-be58-83cf86abb58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-11479475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8716b66a-c86d-4013-87eb-5662a3f2fa21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:13Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0157b23-6913-4f78-9aa8-ef20e3f87168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0157b23-6913-4f78-9aa8-ef20e3f87168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a585de1-766c-448c-bc4a-2bbeedea49cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a585de1-766c-448c-bc4a-2bbeedea49cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8716b66a-c86d-4013-87eb-5662a3f2fa21', 'volume_name': 'volume-8716b66a-c86d-4013-87eb-5662a3f2fa21', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64abf1e-1f74-4e28-92fc-e2243af03cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64abf1e-1f74-4e28-92fc-e2243af03cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bb4e1b-2c34-40eb-a376-8004276b6407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume 8716b66a-c86d-4013-87eb-5662a3f2fa21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8716b66a-c86d-4013-87eb-5662a3f2fa21', 'volume_size': 1} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:13 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 1073741824" returned: 0 in 0.917s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:13 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 Jul 05 17:38:13 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (11105fd8-8825-422a-b4d8-c3e7fe606b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378245ab-b8e5-491e-9d35-d30ea97b61f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378245ab-b8e5-491e-9d35-d30ea97b61f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844911741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a13dea-0274-4f58-828f-0a7ec38834d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:14Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d350274-3a0a-43d4-a2d3-19cf4185ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d350274-3a0a-43d4-a2d3-19cf4185ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08febe01-ff12-46d7-a11a-d8b545e9541e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08febe01-ff12-46d7-a11a-d8b545e9541e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a13dea-0274-4f58-828f-0a7ec38834d9', 'volume_name': 'volume-a3a13dea-0274-4f58-828f-0a7ec38834d9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36444fd-e430-408d-aebd-d8cf8c05ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36444fd-e430-408d-aebd-d8cf8c05ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799b7ea8-387b-4187-b966-22346aab10b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:13 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume a3a13dea-0274-4f58-828f-0a7ec38834d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a13dea-0274-4f58-828f-0a7ec38834d9', 'volume_size': 1} Jul 05 17:38:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (bdd2e759-a551-4c90-8cca-cd56baaf2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c012dbb-46a8-45d7-b95e-68065e1b3420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c012dbb-46a8-45d7-b95e-68065e1b3420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243676027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab88695-5dfc-4370-999c-fdca1f59f4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:14Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e165c9-2757-4848-96bb-55c1ad458156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e165c9-2757-4848-96bb-55c1ad458156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3eec61-2b73-4aa3-add6-b739c530bfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3eec61-2b73-4aa3-add6-b739c530bfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab88695-5dfc-4370-999c-fdca1f59f4fa', 'volume_name': 'volume-cab88695-5dfc-4370-999c-fdca1f59f4fa', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309c71d5-49d1-40ee-8971-d6e8c1ed367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309c71d5-49d1-40ee-8971-d6e8c1ed367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406c5f0f-6e9b-4dbd-9cce-1ff9102a0b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:14 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume cab88695-5dfc-4370-999c-fdca1f59f4fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab88695-5dfc-4370-999c-fdca1f59f4fa', 'volume_size': 1} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:14 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045" returned: 0 in 0.656s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.231s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404717602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7e447d-3775-40ae-83db-24663df8022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:13Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Creating volume 5f7e447d-3775-40ae-83db-24663df8022c {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:14 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81c873d-2491-4940-aafd-0a6a52c2100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:14 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c 1073741824 Jul 05 17:38:14 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f79aad-8d74-44be-bd82-6c41f6cfacb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:14 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 (4d464e15-ba39-4dd3-b5a8-69dd3356f045): created successfully Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f79aad-8d74-44be-bd82-6c41f6cfacb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:14 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (5da9d2c1-be20-4b28-af0e-c6fcddb54b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:14 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-78e0e27a-3617-4867-abdc-203a1a945990 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created volume successfully. Jul 05 17:38:15 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c 1073741824" returned: 0 in 0.806s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:15 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c Jul 05 17:38:15 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:15 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c" returned: 0 in 0.643s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.346s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-11479475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8716b66a-c86d-4013-87eb-5662a3f2fa21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:13Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Creating volume 8716b66a-c86d-4013-87eb-5662a3f2fa21 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:15 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:15 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 1073741824 Jul 05 17:38:15 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3207c6ff-3d69-4ee8-a226-0555403ab5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7e447d-3775-40ae-83db-24663df8022c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8457de-1b93-4bbb-8648-3f08fc68c204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:15 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume volume-5f7e447d-3775-40ae-83db-24663df8022c (5f7e447d-3775-40ae-83db-24663df8022c): created successfully Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8457de-1b93-4bbb-8648-3f08fc68c204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:15 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (b6e8459f-f356-4c34-9005-447240b925bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-65d79f9b-0396-4700-9476-22618a92e6ec tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created volume successfully. Jul 05 17:38:16 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 1073741824" returned: 0 in 0.805s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:16 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 Jul 05 17:38:16 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:17 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21" returned: 0 in 0.615s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.426s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844911741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a13dea-0274-4f58-828f-0a7ec38834d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:14Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Creating volume a3a13dea-0274-4f58-828f-0a7ec38834d9 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:17 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bb4e1b-2c34-40eb-a376-8004276b6407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8716b66a-c86d-4013-87eb-5662a3f2fa21', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:17 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 1073741824 Jul 05 17:38:17 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b2ce3b-a489-4c74-952e-2070c492fd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:17 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 (8716b66a-c86d-4013-87eb-5662a3f2fa21): created successfully Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b2ce3b-a489-4c74-952e-2070c492fd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (a17ff267-f8ed-4451-b2da-a9c1acbbe890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3b0f9872-0731-4475-87cc-694a6707b1ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created volume successfully. Jul 05 17:38:18 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 1073741824" returned: 0 in 0.797s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:18 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 Jul 05 17:38:18 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:18 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9" returned: 0 in 0.611s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.539s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243676027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab88695-5dfc-4370-999c-fdca1f59f4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16c3e76d93471d88303d21c381a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:14Z,use_quota=True,user_id='d94f38c22d0547519819a412f6524721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Creating volume cab88695-5dfc-4370-999c-fdca1f59f4fa {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:18 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:18 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa 1073741824 Jul 05 17:38:18 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799b7ea8-387b-4187-b966-22346aab10b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a13dea-0274-4f58-828f-0a7ec38834d9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2704f3b-9c2e-42f7-818b-6354570cf40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:18 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 (a3a13dea-0274-4f58-828f-0a7ec38834d9): created successfully Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2704f3b-9c2e-42f7-818b-6354570cf40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:18 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (11105fd8-8825-422a-b4d8-c3e7fe606b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:18 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-bfd161b3-b2be-4b18-a03f-749f05949c8d tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created volume successfully. Jul 05 17:38:19 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa 1073741824" returned: 0 in 0.839s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:19 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa Jul 05 17:38:19 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:20 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa" returned: 0 in 0.637s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406c5f0f-6e9b-4dbd-9cce-1ff9102a0b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab88695-5dfc-4370-999c-fdca1f59f4fa', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c090ef9b-9327-460a-94fc-462944afa6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:20 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Volume volume-cab88695-5dfc-4370-999c-fdca1f59f4fa (cab88695-5dfc-4370-999c-fdca1f59f4fa): created successfully Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c090ef9b-9327-460a-94fc-462944afa6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Flow 'volume_create_manager' (bdd2e759-a551-4c90-8cca-cd56baaf2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-258449fa-a9dd-4d55-83eb-d55bb00745d0 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created volume successfully. Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-cab88695-5dfc-4370-999c-fdca1f59f4fa-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-cab88695-5dfc-4370-999c-fdca1f59f4fa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-quobyte-cab88695-5dfc-4370-999c-fdca1f59f4fa" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-cab88695-5dfc-4370-999c-fdca1f59f4fa" acquired by "delete_volume" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e26508-e5dc-4677-bd5a-052e637986fb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:20 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa Jul 05 17:38:20 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:21 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa" returned: 0 in 0.734s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:21 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa Jul 05 17:38:21 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:22 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-cab88695-5dfc-4370-999c-fdca1f59f4fa" returned: 0 in 0.641s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-cab88695-5dfc-4370-999c-fdca1f59f4fa" released by "delete_volume" :: held 1.411s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created reservations ['535320ad-cead-4ace-abbb-0a7d6d4eea23', '63d9dd8b-7a66-4ac4-aa5a-a1c3c14433c3', '85095ea4-ba69-48a5-bcf0-fd297c1db49d', 'e4d1b619-1a97-47c9-bd72-35def04305d1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:22 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:22 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-a3a13dea-0274-4f58-828f-0a7ec38834d9-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:22 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.655s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-a3a13dea-0274-4f58-828f-0a7ec38834d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:23 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Deleted volume successfully. Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-003e2b92-f8f6-400b-8b56-902356b94648 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-cab88695-5dfc-4370-999c-fdca1f59f4fa-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-quobyte-a3a13dea-0274-4f58-828f-0a7ec38834d9" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-a3a13dea-0274-4f58-828f-0a7ec38834d9" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbdc66e-641c-492e-9224-8573131be93c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:23 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 Jul 05 17:38:23 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:23 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9" returned: 0 in 0.732s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:23 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9 Jul 05 17:38:23 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:24 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a3a13dea-0274-4f58-828f-0a7ec38834d9" returned: 0 in 0.644s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-a3a13dea-0274-4f58-828f-0a7ec38834d9" released by "delete_volume" :: held 1.413s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created reservations ['882b376c-4bb7-42fc-a2ed-9d9583ecf020', 'a92678de-9029-453a-9262-50ffc7bbff4c', '99c12075-75b6-4a77-8054-683123542667', '423cf1af-3669-44d4-9407-c48c80180990'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:24 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:24 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-8716b66a-c86d-4013-87eb-5662a3f2fa21-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:25 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.653s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-8716b66a-c86d-4013-87eb-5662a3f2fa21-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Deleted volume successfully. Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5d676d06-cd83-46eb-9a98-92b5c1c1fb36 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-a3a13dea-0274-4f58-828f-0a7ec38834d9-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-quobyte-8716b66a-c86d-4013-87eb-5662a3f2fa21" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-8716b66a-c86d-4013-87eb-5662a3f2fa21" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f08f16-fbfd-424f-bd2f-7d5cae64b74d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:25 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 Jul 05 17:38:25 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:26 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21" returned: 0 in 0.753s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:26 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21 Jul 05 17:38:26 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:26 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8716b66a-c86d-4013-87eb-5662a3f2fa21" returned: 0 in 0.630s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-8716b66a-c86d-4013-87eb-5662a3f2fa21" released by "delete_volume" :: held 1.421s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created reservations ['1752a523-a26d-43ea-b77e-217e2bcbb6dc', 'fcc2010a-58e5-47d5-a115-0d0430584b4d', '1b196c1e-e849-45c7-87a8-dafc0aa0e011', '6b103fb8-abae-465b-a2f4-f4994d1a71a1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:26 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:26 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-5f7e447d-3775-40ae-83db-24663df8022c-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-5f7e447d-3775-40ae-83db-24663df8022c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:27 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.640s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Deleted volume successfully. Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-quobyte-5f7e447d-3775-40ae-83db-24663df8022c" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-73748d63-a504-4b43-8e31-df2a18e094ce tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-8716b66a-c86d-4013-87eb-5662a3f2fa21-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-5f7e447d-3775-40ae-83db-24663df8022c" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[45406925-55a5-4c85-8990-4b82c48b89af]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:27 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c Jul 05 17:38:27 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:28 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c" returned: 0 in 0.740s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:28 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c Jul 05 17:38:28 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:28 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-5f7e447d-3775-40ae-83db-24663df8022c" returned: 0 in 0.623s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-5f7e447d-3775-40ae-83db-24663df8022c" released by "delete_volume" :: held 1.400s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:28 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created reservations ['929e6310-d013-4811-bb9e-b2c085d6f7ab', '978a0f37-8490-4789-8ebb-b30f97d61ae6', '9a28a1ce-fc70-4256-a469-bfdffa9db675', 'ee43dca4-83ad-498a-9e20-7fbb94e9bfe9'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:29 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:29 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-4d464e15-ba39-4dd3-b5a8-69dd3356f045-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-4d464e15-ba39-4dd3-b5a8-69dd3356f045-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:29 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.671s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Deleted volume successfully. Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-quobyte-4d464e15-ba39-4dd3-b5a8-69dd3356f045" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-21405f78-0d1b-49b7-a1b1-f9afdb96ab04 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-5f7e447d-3775-40ae-83db-24663df8022c-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-4d464e15-ba39-4dd3-b5a8-69dd3356f045" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[02988cce-beef-4745-afb2-a45eb46783ad]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:29 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 Jul 05 17:38:29 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:30 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045" returned: 0 in 0.730s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:30 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045 Jul 05 17:38:30 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:31 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-4d464e15-ba39-4dd3-b5a8-69dd3356f045" returned: 0 in 0.646s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-4d464e15-ba39-4dd3-b5a8-69dd3356f045" released by "delete_volume" :: held 1.411s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created reservations ['3b2ec970-28f9-4d62-b2ef-9df87d7b0b83', '75ebfaa5-d993-47d4-aba6-a6eab35633e5', '43cca4dd-dc2b-4259-81ad-53d06bda55dd', 'a5245197-870d-4aa2-89bd-79e1d10e2755'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:31 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:31 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-170123cf-7a38-41e5-b99c-d7f5e408814c-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-170123cf-7a38-41e5-b99c-d7f5e408814c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-quobyte-6fa36c54-28cc-481f-8734-73025a3bdb57" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-6fa36c54-28cc-481f-8734-73025a3bdb57" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-quobyte-170123cf-7a38-41e5-b99c-d7f5e408814c" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:31 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.648s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-170123cf-7a38-41e5-b99c-d7f5e408814c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Deleting offline snapshot 170123cf-7a38-41e5-b99c-d7f5e408814c of volume 6fa36c54-28cc-481f-8734-73025a3bdb57 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] snapshot_file for this snap is: volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:38:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Deleted volume successfully. Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e92fcc-a271-48cf-8228-db3e3cdf4156]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-30321e6e-fb15-42f2-8a3c-7625d055ecd1 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-4d464e15-ba39-4dd3-b5a8-69dd3356f045-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:32 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c Jul 05 17:38:32 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:32 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c" returned: 0 in 0.749s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa36c54-28cc-481f-8734-73025a3bdb57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:38:32 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[573035c8-17be-42b8-a5ac-74bf74a0c893]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:32 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 Jul 05 17:38:32 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:33 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57" returned: 0 in 0.749s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:33 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c Jul 05 17:38:33 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:34 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c" returned: 0 in 0.709s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:34 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c Jul 05 17:38:34 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:34 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57.170123cf-7a38-41e5-b99c-d7f5e408814c" returned: 0 in 0.616s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-170123cf-7a38-41e5-b99c-d7f5e408814c" released by "_delete_snapshot" :: held 2.923s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-6fa36c54-28cc-481f-8734-73025a3bdb57" released by "delete_snapshot" :: held 2.949s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:34 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created reservations ['3d5a7813-07d4-482b-9e77-36ac27db5b15', 'e69b5025-ad9a-4931-8b96-ec0d1fd0becb', '278bbe1d-f146-4852-a06a-3a4880e8e83b', '4512cd9d-2c26-4119-950d-895aaf6c83c0'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Delete snapshot completed successfully. Jul 05 17:38:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9e2e3fdc-f9d7-4d10-ae19-39681692d144 tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-170123cf-7a38-41e5-b99c-d7f5e408814c-delete_snapshot" released by "delete_snapshot" :: held 3.070s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-6fa36c54-28cc-481f-8734-73025a3bdb57-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-6fa36c54-28cc-481f-8734-73025a3bdb57-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "cinder-quobyte-6fa36c54-28cc-481f-8734-73025a3bdb57" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-6fa36c54-28cc-481f-8734-73025a3bdb57" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8770dadd-845f-464b-91d8-3225567c6b86]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:35 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 Jul 05 17:38:35 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:35 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57" returned: 0 in 0.715s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:35 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57 Jul 05 17:38:35 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:36 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6fa36c54-28cc-481f-8734-73025a3bdb57" returned: 0 in 0.642s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-quobyte-6fa36c54-28cc-481f-8734-73025a3bdb57" released by "delete_volume" :: held 1.410s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Created reservations ['fe5587af-8912-4237-af1e-a8413c222992', '97d721cd-05c9-4a6e-8531-ecbf3776ef01', '0f10f3c0-b70e-4a46-bce1-7766d6ddac8f', '02c96f29-332f-4de6-94b1-ddf151b6d09e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:36 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:36 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:37 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.643s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:37 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Deleted volume successfully. Jul 05 17:38:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25c7e8df-b6cb-45c3-b0f0-41f15f7992fa tempest-CreateVolumesFromSnapshotTest-1444480426 None] Lock "cinder-6fa36c54-28cc-481f-8734-73025a3bdb57-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Flow 'volume_create_manager' (2b7cdd2e-87fd-471b-9689-fda47e16c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9ca132-608c-41b5-baee-27765d511b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9ca132-608c-41b5-baee-27765d511b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648968419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a958c5f-e67a-41eb-8004-137a659e6fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4abdcfeb3264e06a6d89e468bbac78a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:40Z,use_quota=True,user_id='4f5100ded873459f83b427d463ebad3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3530dd38-b662-4144-bd02-0ba969a8d9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3530dd38-b662-4144-bd02-0ba969a8d9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff8fd2b-b875-47de-8550-1ff51a9e9b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff8fd2b-b875-47de-8550-1ff51a9e9b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a958c5f-e67a-41eb-8004-137a659e6fce', 'volume_name': 'volume-7a958c5f-e67a-41eb-8004-137a659e6fce', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd53a04-e06c-4d23-bde2-5bef8c6d6594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd53a04-e06c-4d23-bde2-5bef8c6d6594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bcf7fd-1710-4327-a4f2-43db1868dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:40 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Volume 7a958c5f-e67a-41eb-8004-137a659e6fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a958c5f-e67a-41eb-8004-137a659e6fce', 'volume_size': 1} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648968419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a958c5f-e67a-41eb-8004-137a659e6fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4abdcfeb3264e06a6d89e468bbac78a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:40Z,use_quota=True,user_id='4f5100ded873459f83b427d463ebad3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Creating volume 7a958c5f-e67a-41eb-8004-137a659e6fce {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:40 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:40 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce 1073741824 Jul 05 17:38:40 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:41 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce 1073741824" returned: 0 in 0.793s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:41 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce Jul 05 17:38:41 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:42 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce" returned: 0 in 0.619s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bcf7fd-1710-4327-a4f2-43db1868dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a958c5f-e67a-41eb-8004-137a659e6fce', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b2d299-25bb-49db-9b6c-8587aa2be101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:42 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Volume volume-7a958c5f-e67a-41eb-8004-137a659e6fce (7a958c5f-e67a-41eb-8004-137a659e6fce): created successfully Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b2d299-25bb-49db-9b6c-8587aa2be101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Flow 'volume_create_manager' (2b7cdd2e-87fd-471b-9689-fda47e16c972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-bb37f531-1eeb-48c8-be3a-e6c1b1b82925 tempest-ProjectReaderTests-1558447783 None] Created volume successfully. Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Acquiring lock "cinder-7a958c5f-e67a-41eb-8004-137a659e6fce-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Lock "cinder-7a958c5f-e67a-41eb-8004-137a659e6fce-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Acquiring lock "cinder-quobyte-7a958c5f-e67a-41eb-8004-137a659e6fce" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Lock "cinder-quobyte-7a958c5f-e67a-41eb-8004-137a659e6fce" acquired by "delete_volume" :: waited 0.013s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3399f6ba-55ff-40c4-83b5-9d58a6e138b2]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:42 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce Jul 05 17:38:42 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:43 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce" returned: 0 in 0.767s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:43 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce Jul 05 17:38:43 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:44 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a958c5f-e67a-41eb-8004-137a659e6fce" returned: 0 in 0.642s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Lock "cinder-quobyte-7a958c5f-e67a-41eb-8004-137a659e6fce" released by "delete_volume" :: held 1.448s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Created reservations ['5b67aa46-00f1-40b9-9dfb-f913a5ddecc8', '3a3cfaba-e9af-447a-88a9-5d8d004669b0', '24960b80-edb0-4a95-be7e-8bf3fd568a16', 'dd717045-8ae3-4fe2-9e43-f36fd7113a45'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:44 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:44 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:44 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.662s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:44 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Deleted volume successfully. Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64488d78-8e3a-474d-b302-e960b001ab69 tempest-ProjectReaderTests-1558447783 None] Lock "cinder-7a958c5f-e67a-41eb-8004-137a659e6fce-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Flow 'volume_create_manager' (03e1a1fb-ba45-480c-bbf9-2801c762067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6236c622-cc5a-4bf9-a02f-92d0b422a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6236c622-cc5a-4bf9-a02f-92d0b422a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203967461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43060acc-c43b-46aa-8822-cdde06535271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4abdcfeb3264e06a6d89e468bbac78a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:45Z,use_quota=True,user_id='4f5100ded873459f83b427d463ebad3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a37594-9ab0-4f11-b7e9-ccb3ead2f5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a37594-9ab0-4f11-b7e9-ccb3ead2f5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41abea69-0f6b-4a1e-80f1-a7edd2deb490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41abea69-0f6b-4a1e-80f1-a7edd2deb490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43060acc-c43b-46aa-8822-cdde06535271', 'volume_name': 'volume-43060acc-c43b-46aa-8822-cdde06535271', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d78570b-fd3c-4ace-b850-19cfc1c6425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d78570b-fd3c-4ace-b850-19cfc1c6425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47837e32-6f0f-4d04-9f10-9d4e12f432c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:45 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Volume 43060acc-c43b-46aa-8822-cdde06535271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43060acc-c43b-46aa-8822-cdde06535271', 'volume_size': 1} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203967461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43060acc-c43b-46aa-8822-cdde06535271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4abdcfeb3264e06a6d89e468bbac78a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:45Z,use_quota=True,user_id='4f5100ded873459f83b427d463ebad3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Creating volume 43060acc-c43b-46aa-8822-cdde06535271 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:45 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:45 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 1073741824 Jul 05 17:38:45 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:46 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 1073741824" returned: 0 in 0.785s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:46 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 Jul 05 17:38:46 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:46 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271" returned: 0 in 0.623s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47837e32-6f0f-4d04-9f10-9d4e12f432c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43060acc-c43b-46aa-8822-cdde06535271', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0f3f8f-0f3c-4bd8-a958-6af6045d7258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:46 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Volume volume-43060acc-c43b-46aa-8822-cdde06535271 (43060acc-c43b-46aa-8822-cdde06535271): created successfully Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0f3f8f-0f3c-4bd8-a958-6af6045d7258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:46 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Flow 'volume_create_manager' (03e1a1fb-ba45-480c-bbf9-2801c762067e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-69c92663-0209-4af5-af07-21abf7ffa1b1 tempest-ProjectReaderTests-1558447783 None] Created volume successfully. Jul 05 17:38:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Acquiring lock "cinder-43060acc-c43b-46aa-8822-cdde06535271-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Lock "cinder-43060acc-c43b-46aa-8822-cdde06535271-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Acquiring lock "cinder-quobyte-43060acc-c43b-46aa-8822-cdde06535271" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Lock "cinder-quobyte-43060acc-c43b-46aa-8822-cdde06535271" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:47 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[be54df21-3b02-4e22-a604-c7ec28ca1866]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:47 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 Jul 05 17:38:47 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:48 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271" returned: 0 in 0.736s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:48 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271 Jul 05 17:38:48 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:48 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43060acc-c43b-46aa-8822-cdde06535271" returned: 0 in 0.633s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Lock "cinder-quobyte-43060acc-c43b-46aa-8822-cdde06535271" released by "delete_volume" :: held 1.409s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:48 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Created reservations ['859ba9a5-0e39-467d-8492-e37bd8bb5b46', '8fc208ea-c71a-4f10-b835-9682bbdd6190', '4ddeab04-2f1e-4dcb-a294-67ed2f537e74', 'd9bd5ffe-d6ba-4a29-9887-97efa5c61f49'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:49 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:49 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:49 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.653s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Deleted volume successfully. Jul 05 17:38:49 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e6dd8c0e-cc53-49d5-bf00-e18ec6a0e68d tempest-ProjectReaderTests-1558447783 None] Lock "cinder-43060acc-c43b-46aa-8822-cdde06535271-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:38:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:50 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:50 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:51 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.737s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:38:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:38:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Flow 'volume_create_manager' (fb2c1e2d-213b-44cb-b7af-4ceec646b576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46980926-1e18-4379-9d5f-38f76af8b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46980926-1e18-4379-9d5f-38f76af8b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128584460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8a2d86-6a75-4dab-bbd2-3c381699f69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdde8e5275e432991bf4c4920c93316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:53Z,use_quota=True,user_id='0e40c7f636bc47f0bc6b69b7be412de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d92ffed-9aec-4814-8566-cbf4efc2a581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d92ffed-9aec-4814-8566-cbf4efc2a581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a81112f-85f7-409c-98d0-7e8bffe2ba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a81112f-85f7-409c-98d0-7e8bffe2ba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8a2d86-6a75-4dab-bbd2-3c381699f69a', 'volume_name': 'volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f867c403-e0be-4582-95d7-f5c3c91697b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f867c403-e0be-4582-95d7-f5c3c91697b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b7b911-b073-4d10-85ab-e9ccbc40875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:53 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Volume 2e8a2d86-6a75-4dab-bbd2-3c381699f69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a', 'volume_size': 1} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128584460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8a2d86-6a75-4dab-bbd2-3c381699f69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdde8e5275e432991bf4c4920c93316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:53Z,use_quota=True,user_id='0e40c7f636bc47f0bc6b69b7be412de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Creating volume 2e8a2d86-6a75-4dab-bbd2-3c381699f69a {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:53 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:53 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a 1073741824 Jul 05 17:38:53 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:54 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a 1073741824" returned: 0 in 0.798s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:54 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a Jul 05 17:38:54 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:54 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a" returned: 0 in 0.627s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b7b911-b073-4d10-85ab-e9ccbc40875f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22da95a0-1f91-48c4-a334-103afa049749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:54 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Volume volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a (2e8a2d86-6a75-4dab-bbd2-3c381699f69a): created successfully Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22da95a0-1f91-48c4-a334-103afa049749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Flow 'volume_create_manager' (fb2c1e2d-213b-44cb-b7af-4ceec646b576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5f64f3f7-2bda-40b9-be79-72223f8b700d tempest-ProjectReaderTests-1276191592 None] Created volume successfully. Jul 05 17:38:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "cinder-2e8a2d86-6a75-4dab-bbd2-3c381699f69a-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-2e8a2d86-6a75-4dab-bbd2-3c381699f69a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "cinder-quobyte-2e8a2d86-6a75-4dab-bbd2-3c381699f69a" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:38:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-quobyte-2e8a2d86-6a75-4dab-bbd2-3c381699f69a" acquired by "delete_volume" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:38:55 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[300af05d-8bc0-44f2-9fcd-58d624d5d975]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:38:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:55 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a Jul 05 17:38:55 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:56 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a" returned: 0 in 0.733s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:56 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a Jul 05 17:38:56 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:56 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2e8a2d86-6a75-4dab-bbd2-3c381699f69a" returned: 0 in 0.620s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-quobyte-2e8a2d86-6a75-4dab-bbd2-3c381699f69a" released by "delete_volume" :: held 1.389s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:56 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Created reservations ['e59bdb73-ec14-4ae4-b8ab-11f2d82d5e3a', '16f27192-8ab4-421d-ba84-168b5797a153', '88edb4b3-8df6-446d-bc77-e1b7b609e5d3', 'e8fb7998-1c31-428b-b1f6-9e065d46cac8'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:57 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:38:57 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:57 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.629s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:38:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Deleted volume successfully. Jul 05 17:38:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7b7e7240-1a0a-4b1c-b779-a206414977b8 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-2e8a2d86-6a75-4dab-bbd2-3c381699f69a-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Flow 'volume_create_manager' (e43e5332-36bd-41f8-9e26-68d9ad79bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826d33fa-7eaa-46c8-bf17-43d37ed9b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826d33fa-7eaa-46c8-bf17-43d37ed9b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1658430227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70116d3-323b-42e5-b987-939c0720623c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdde8e5275e432991bf4c4920c93316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:58Z,use_quota=True,user_id='0e40c7f636bc47f0bc6b69b7be412de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21059c0-9d59-4048-ac2a-7267ee284948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21059c0-9d59-4048-ac2a-7267ee284948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e18c333-f07b-44ae-b1ae-8c7297d85091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e18c333-f07b-44ae-b1ae-8c7297d85091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70116d3-323b-42e5-b987-939c0720623c', 'volume_name': 'volume-e70116d3-323b-42e5-b987-939c0720623c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21165794-dd77-4f16-8bfd-f96a0e0d2908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21165794-dd77-4f16-8bfd-f96a0e0d2908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a30b3da-b215-49a0-b959-44fb0cd8b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:58 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Volume e70116d3-323b-42e5-b987-939c0720623c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70116d3-323b-42e5-b987-939c0720623c', 'volume_size': 1} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1658430227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70116d3-323b-42e5-b987-939c0720623c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdde8e5275e432991bf4c4920c93316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:38:58Z,use_quota=True,user_id='0e40c7f636bc47f0bc6b69b7be412de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Creating volume e70116d3-323b-42e5-b987-939c0720623c {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:38:58 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:58 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c 1073741824 Jul 05 17:38:58 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:58 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c 1073741824" returned: 0 in 0.769s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:38:59 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c Jul 05 17:38:59 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:38:59 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 05 17:38:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c" returned: 0 in 0.627s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:38:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:38:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:38:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a30b3da-b215-49a0-b959-44fb0cd8b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70116d3-323b-42e5-b987-939c0720623c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d00fd42-d54e-460c-90cf-4328d012f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:38:59 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Volume volume-e70116d3-323b-42e5-b987-939c0720623c (e70116d3-323b-42e5-b987-939c0720623c): created successfully Jul 05 17:38:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d00fd42-d54e-460c-90cf-4328d012f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:38:59 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Flow 'volume_create_manager' (e43e5332-36bd-41f8-9e26-68d9ad79bad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:38:59 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-025979be-f5d7-4624-95f8-1e09cf69c7e0 tempest-ProjectReaderTests-1276191592 None] Created volume successfully. Jul 05 17:39:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "cinder-e70116d3-323b-42e5-b987-939c0720623c-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-e70116d3-323b-42e5-b987-939c0720623c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "cinder-quobyte-e70116d3-323b-42e5-b987-939c0720623c" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-quobyte-e70116d3-323b-42e5-b987-939c0720623c" acquired by "delete_volume" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[52138def-d7aa-451b-905e-07ec8194df66]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:00 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c Jul 05 17:39:00 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:01 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c" returned: 0 in 0.715s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:01 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c Jul 05 17:39:01 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:01 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e70116d3-323b-42e5-b987-939c0720623c" returned: 0 in 0.607s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-quobyte-e70116d3-323b-42e5-b987-939c0720623c" released by "delete_volume" :: held 1.359s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Created reservations ['ce650db2-be29-44ea-bc9e-913c89dffc6e', 'f47c42e4-c6aa-444d-a8ef-8e0bbac65176', '292a2bca-2c4f-432e-8188-3106d61f5e44', '6e065b28-925a-4edb-a20a-ea28fb176a02'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:01 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:01 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:02 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.667s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:02 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Deleted volume successfully. Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6faba308-f4ff-460a-8794-02c267db81c3 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-e70116d3-323b-42e5-b987-939c0720623c-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Flow 'volume_create_manager' (c8895e90-48ab-43d2-ab7b-c44af758325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dee041-33e5-41da-90d7-95ae9a0d396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dee041-33e5-41da-90d7-95ae9a0d396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661545286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be08ebe7-e159-4fe9-9b30-89906e2c286c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdde8e5275e432991bf4c4920c93316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:03Z,use_quota=True,user_id='0e40c7f636bc47f0bc6b69b7be412de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f007334b-2091-468e-867c-03c9d21d67e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f007334b-2091-468e-867c-03c9d21d67e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a10121e-3c06-4902-bd75-f8cceecaee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a10121e-3c06-4902-bd75-f8cceecaee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be08ebe7-e159-4fe9-9b30-89906e2c286c', 'volume_name': 'volume-be08ebe7-e159-4fe9-9b30-89906e2c286c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e7a0b8-99a0-40f6-a313-6a54ffd28566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e7a0b8-99a0-40f6-a313-6a54ffd28566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d884119f-ff8c-4354-ace4-4201b2461b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:02 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Volume be08ebe7-e159-4fe9-9b30-89906e2c286c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be08ebe7-e159-4fe9-9b30-89906e2c286c', 'volume_size': 1} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661545286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be08ebe7-e159-4fe9-9b30-89906e2c286c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdde8e5275e432991bf4c4920c93316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:03Z,use_quota=True,user_id='0e40c7f636bc47f0bc6b69b7be412de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Creating volume be08ebe7-e159-4fe9-9b30-89906e2c286c {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:02 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:03 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c 1073741824 Jul 05 17:39:03 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:03 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c 1073741824" returned: 0 in 0.799s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:03 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c Jul 05 17:39:03 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:04 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c" returned: 0 in 0.644s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d884119f-ff8c-4354-ace4-4201b2461b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be08ebe7-e159-4fe9-9b30-89906e2c286c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4261149c-b48a-411f-919c-63cb4234cc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:04 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=72,cinder:INSERT=27,cinder:UPDATE=124,cinder:DELETE=17 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:39:04 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Volume volume-be08ebe7-e159-4fe9-9b30-89906e2c286c (be08ebe7-e159-4fe9-9b30-89906e2c286c): created successfully Jul 05 17:39:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4261149c-b48a-411f-919c-63cb4234cc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Flow 'volume_create_manager' (c8895e90-48ab-43d2-ab7b-c44af758325f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2f3a2fef-0467-4b2e-b03f-7aeae8b4141a tempest-ProjectReaderTests-1276191592 None] Created volume successfully. Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "cinder-be08ebe7-e159-4fe9-9b30-89906e2c286c-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-be08ebe7-e159-4fe9-9b30-89906e2c286c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=118,cinder:SELECT=91,cinder:INSERT=29,cinder:DELETE=5 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "cinder-quobyte-be08ebe7-e159-4fe9-9b30-89906e2c286c" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-quobyte-be08ebe7-e159-4fe9-9b30-89906e2c286c" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c80002-a769-4f7c-82aa-3c61d28c719a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:05 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c Jul 05 17:39:05 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:05 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c" returned: 0 in 0.735s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:05 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c Jul 05 17:39:05 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:06 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-be08ebe7-e159-4fe9-9b30-89906e2c286c" returned: 0 in 0.615s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-quobyte-be08ebe7-e159-4fe9-9b30-89906e2c286c" released by "delete_volume" :: held 1.387s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Created reservations ['df887cb7-53ac-4463-ab41-ce9cc4c8f9f0', '7a965278-b8fc-40c0-9e44-317910d36e82', '187d1601-0ca9-4162-afad-b446c0774f3e', 'b5eedde2-c15b-4b89-8117-dd5d0ace36e7'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:06 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:06 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:07 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.625s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Deleted volume successfully. Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-fdcb1aa3-9018-4694-9cc6-71ddbd55dd25 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-be08ebe7-e159-4fe9-9b30-89906e2c286c-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Flow 'volume_create_manager' (13cb247d-3b0f-47af-8d5a-b06781eb0fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb12b5d-ced0-4fc3-9b15-99c111fac594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb12b5d-ced0-4fc3-9b15-99c111fac594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762551622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ec6aa8-af7d-4473-a7bb-bf6652aedbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdde8e5275e432991bf4c4920c93316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:08Z,use_quota=True,user_id='0e40c7f636bc47f0bc6b69b7be412de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890d19a0-6f87-44dd-9ae7-7b0578adbee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890d19a0-6f87-44dd-9ae7-7b0578adbee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99086df9-2888-45aa-ae06-b70c6ca8f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99086df9-2888-45aa-ae06-b70c6ca8f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ec6aa8-af7d-4473-a7bb-bf6652aedbfc', 'volume_name': 'volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645d0f04-b46b-4ba7-be13-21d82101b87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645d0f04-b46b-4ba7-be13-21d82101b87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f4a686-fefd-45a3-9dab-e5aa3d5d4294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:07 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Volume 36ec6aa8-af7d-4473-a7bb-bf6652aedbfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc', 'volume_size': 1} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762551622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ec6aa8-af7d-4473-a7bb-bf6652aedbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdde8e5275e432991bf4c4920c93316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:08Z,use_quota=True,user_id='0e40c7f636bc47f0bc6b69b7be412de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Creating volume 36ec6aa8-af7d-4473-a7bb-bf6652aedbfc {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:07 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:07 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc 1073741824 Jul 05 17:39:07 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:08 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc 1073741824" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:08 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc Jul 05 17:39:08 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:09 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc" returned: 0 in 0.638s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f4a686-fefd-45a3-9dab-e5aa3d5d4294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3f6564-6c3b-4292-9b33-921cc0c39304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:09 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Volume volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc (36ec6aa8-af7d-4473-a7bb-bf6652aedbfc): created successfully Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3f6564-6c3b-4292-9b33-921cc0c39304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Flow 'volume_create_manager' (13cb247d-3b0f-47af-8d5a-b06781eb0fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8d8075dd-fd7a-4214-8462-e107674be1ee tempest-ProjectReaderTests-1276191592 None] Created volume successfully. Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "cinder-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "cinder-quobyte-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-quobyte-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8b3b8-a9bb-4ab0-93ce-ca27ddb35b22]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:09 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc Jul 05 17:39:09 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:10 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc" returned: 0 in 0.722s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:10 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc Jul 05 17:39:10 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:11 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc" returned: 0 in 0.615s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-quobyte-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc" released by "delete_volume" :: held 1.373s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Created reservations ['6a21ecde-da1a-41c0-a8cf-c389361caa86', 'be1fd27b-0476-4e82-9ef0-4a929b513b9d', 'f9c1736e-b693-4c4f-a5d5-791fdabc8949', 'dc2a3001-83b7-430e-bd35-eaf6c6cc590a'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:11 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:11 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:11 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.632s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Deleted volume successfully. Jul 05 17:39:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5ba6c787-e7de-4054-a0dd-bfde3b4aa174 tempest-ProjectReaderTests-1276191592 None] Lock "cinder-36ec6aa8-af7d-4473-a7bb-bf6652aedbfc-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:21 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:39:21 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (14def49a-8ece-4fb7-b5a2-26577c1864a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df23004-78af-4e84-aa49-b58546a87171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df23004-78af-4e84-aa49-b58546a87171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1737142308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8138185b-0bc3-457b-b617-2b7a5c6f5f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:24Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd4e834-c3d1-45b9-8438-cb8a06be215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd4e834-c3d1-45b9-8438-cb8a06be215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f9843f-2e72-45fd-85e5-967a379817fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f9843f-2e72-45fd-85e5-967a379817fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8138185b-0bc3-457b-b617-2b7a5c6f5f94', 'volume_name': 'volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a05e808-d131-4c9e-bf67-2413bc27a762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a05e808-d131-4c9e-bf67-2413bc27a762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41bae9a-b8a6-4546-94a7-0488fb54e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:23 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Volume 8138185b-0bc3-457b-b617-2b7a5c6f5f94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94', 'volume_size': 1} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1737142308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8138185b-0bc3-457b-b617-2b7a5c6f5f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:24Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Creating volume 8138185b-0bc3-457b-b617-2b7a5c6f5f94 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:23 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:23 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 1073741824 Jul 05 17:39:23 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (42c1a73e-1766-4b77-8ffe-e870e872f43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbb37cc-b6a1-470b-90ad-692f0401f361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (495d2048-89ad-4b08-ba02-add6ee9da99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e45270-ade2-461d-97fc-06df0de10660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbb37cc-b6a1-470b-90ad-692f0401f361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937162250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a9c07a-0af1-43a2-aa6a-bbae088a383b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:24Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4b18ce-7a1d-4ce2-a9f4-03db6672693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4b18ce-7a1d-4ce2-a9f4-03db6672693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9710c45f-2375-45d9-8fd0-f0131917b36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9710c45f-2375-45d9-8fd0-f0131917b36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a9c07a-0af1-43a2-aa6a-bbae088a383b', 'volume_name': 'volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67651ad0-7e5b-4815-9bf6-12cd51be2796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67651ad0-7e5b-4815-9bf6-12cd51be2796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3064783d-41b7-4adb-b60e-c833fa23a2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume a0a9c07a-0af1-43a2-aa6a-bbae088a383b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b', 'volume_size': 1} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e45270-ade2-461d-97fc-06df0de10660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-467622587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864680cc-9527-42d9-b0af-5cdb64e3dd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:24Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d382c214-81bc-437b-8923-eff431b8dd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d382c214-81bc-437b-8923-eff431b8dd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c3a8de-af51-42c0-a2fc-f0f59bea3ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c3a8de-af51-42c0-a2fc-f0f59bea3ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864680cc-9527-42d9-b0af-5cdb64e3dd22', 'volume_name': 'volume-864680cc-9527-42d9-b0af-5cdb64e3dd22', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8efbb2-3f8e-4963-adc6-9403de8cd931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8efbb2-3f8e-4963-adc6-9403de8cd931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da259f10-e414-41e0-94f7-aaa3e911da13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Volume 864680cc-9527-42d9-b0af-5cdb64e3dd22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864680cc-9527-42d9-b0af-5cdb64e3dd22', 'volume_size': 1} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (85644025-548a-40f7-8d51-85f3ea85391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4274a6b3-5801-4f0b-9c88-8ddab944a665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4274a6b3-5801-4f0b-9c88-8ddab944a665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703233475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e494c03a-6d5d-4749-8fc4-dddc343b6f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:24Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a619caa1-04cb-459d-a14d-f8c184f48136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a619caa1-04cb-459d-a14d-f8c184f48136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73a5534-826c-4aad-9584-e6792de6bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73a5534-826c-4aad-9584-e6792de6bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e494c03a-6d5d-4749-8fc4-dddc343b6f32', 'volume_name': 'volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd50c1f-0ba1-4a24-b921-68bb25d41e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd50c1f-0ba1-4a24-b921-68bb25d41e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c788b6e-fb35-47c7-be5a-75d684c234e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume e494c03a-6d5d-4749-8fc4-dddc343b6f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32', 'volume_size': 1} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (f3b6bbef-a658-4f9b-85c5-840d1acbae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de647d1-735a-48aa-b575-ab91f50b82df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de647d1-735a-48aa-b575-ab91f50b82df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837195593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44579599-37de-4b19-bebe-fa2de3d46828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:25Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc044fd1-8280-4d2f-994f-b4e375e114d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc044fd1-8280-4d2f-994f-b4e375e114d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2775adf9-fdad-488b-91a2-9729aac33ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2775adf9-fdad-488b-91a2-9729aac33ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44579599-37de-4b19-bebe-fa2de3d46828', 'volume_name': 'volume-44579599-37de-4b19-bebe-fa2de3d46828', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1354cce7-6904-405c-a872-81fd6cd2cb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1354cce7-6904-405c-a872-81fd6cd2cb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ab9265-a3e4-4dca-8a37-ea87c08894d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Volume 44579599-37de-4b19-bebe-fa2de3d46828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44579599-37de-4b19-bebe-fa2de3d46828', 'volume_size': 1} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (89e15621-b290-4b5e-b3ee-4e6681889881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92df02fd-0a15-45a0-b6ca-d3b32db0e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92df02fd-0a15-45a0-b6ca-d3b32db0e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230505031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19d27bb-6e3e-410f-b5e5-00db2cbca9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:25Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbfb6e9-7ec7-4e62-8834-f727be6cf52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbfb6e9-7ec7-4e62-8834-f727be6cf52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c1985b-2c93-4a46-b9be-5cec79364006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c1985b-2c93-4a46-b9be-5cec79364006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19d27bb-6e3e-410f-b5e5-00db2cbca9b8', 'volume_name': 'volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722f6b17-2036-4328-8996-76ecb210082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722f6b17-2036-4328-8996-76ecb210082b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef530e01-8227-439e-93c0-b5f3bf916796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Volume e19d27bb-6e3e-410f-b5e5-00db2cbca9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8', 'volume_size': 1} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:25 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 1073741824" returned: 0 in 1.172s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:25 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 Jul 05 17:39:25 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (afcabac2-e49d-4766-b781-4117f7b6f9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a339a126-72a5-472f-b86a-710fbfd91cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a339a126-72a5-472f-b86a-710fbfd91cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922241195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05da037-b111-442e-b1b1-48fb2ec5ecd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:25Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01839c2-e7a9-4360-be16-b53a0bbfee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01839c2-e7a9-4360-be16-b53a0bbfee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b11198-60e1-4a85-8a9a-78b1b9e98568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b11198-60e1-4a85-8a9a-78b1b9e98568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05da037-b111-442e-b1b1-48fb2ec5ecd3', 'volume_name': 'volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94df962c-53e6-4d4d-b44e-fa937c147f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94df962c-53e6-4d4d-b44e-fa937c147f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1471fdb5-2748-4b9d-9e66-dfa664b84030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Volume e05da037-b111-442e-b1b1-48fb2ec5ecd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3', 'volume_size': 1} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:25 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94" returned: 0 in 0.680s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937162250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a9c07a-0af1-43a2-aa6a-bbae088a383b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:24Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Creating volume a0a9c07a-0af1-43a2-aa6a-bbae088a383b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:25 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41bae9a-b8a6-4546-94a7-0488fb54e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666af31c-f7df-4fe5-a469-a54f844c15ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:25 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b 1073741824 Jul 05 17:39:25 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:25 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Volume volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 (8138185b-0bc3-457b-b617-2b7a5c6f5f94): created successfully Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666af31c-f7df-4fe5-a469-a54f844c15ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (14def49a-8ece-4fb7-b5a2-26577c1864a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9f2c22dc-c928-43f4-b8ed-0452cfa2fa33 tempest-CreateVolumesFromImageTest-563140046 None] Created volume successfully. Jul 05 17:39:26 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b 1073741824" returned: 0 in 0.858s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:26 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b Jul 05 17:39:26 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:27 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" returned: 0 in 0.646s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.158s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-467622587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864680cc-9527-42d9-b0af-5cdb64e3dd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:24Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Creating volume 864680cc-9527-42d9-b0af-5cdb64e3dd22 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:27 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3064783d-41b7-4adb-b60e-c833fa23a2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:27 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 1073741824 Jul 05 17:39:27 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751c5d34-8204-41c1-b517-11fd72bb7db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:27 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b (a0a9c07a-0af1-43a2-aa6a-bbae088a383b): created successfully Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751c5d34-8204-41c1-b517-11fd72bb7db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (42c1a73e-1766-4b77-8ffe-e870e872f43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d3c1a540-fd76-40e3-9a72-defea4d58761 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created volume successfully. Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Flow 'volume_create_manager' (3aa3cdae-35a7-4112-9493-321821c151a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5528fd7-a736-47e8-b726-211c6503373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5528fd7-a736-47e8-b726-211c6503373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b602762-b866-4e37-8511-72c5893e4e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882b121f9b784a749d819ce5bbe0ef6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:28Z,use_quota=True,user_id='0b2a5ab9a6e44fe6a323b1777ddfbd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(999fc8ce-f504-44fd-9e7e-db7aaa6ecba9),volume_type_id=999fc8ce-f504-44fd-9e7e-db7aaa6ecba9)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f879719-bd26-4360-a39a-92d665631966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f879719-bd26-4360-a39a-92d665631966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483ccc2b-1c1e-4e45-bb22-10826ffefdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:39:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483ccc2b-1c1e-4e45-bb22-10826ffefdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b602762-b866-4e37-8511-72c5893e4e8b', 'volume_name': 'volume-1b602762-b866-4e37-8511-72c5893e4e8b', 'volume_size': 1, 'image_id': '7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3ea8e8d441bc71b215e4ae1fc00295e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '882b121f9b784a749d819ce5bbe0ef6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cc8870caacb75b352d272f3974b1e0ed807a4f3715f2949145561916ae7924a1fb7d925e7f01d1bacd15b9a25e202efb657364460ac0a3db13cfaf7c025f366', 'id': '7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'created_at': datetime.datetime(2026, 7, 5, 15, 39, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 39, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb33538d-615f-4f1b-90c0-c86fe79aa75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb33538d-615f-4f1b-90c0-c86fe79aa75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4a4f07-203b-431f-b620-f53374a22ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:28 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Volume 1b602762-b866-4e37-8511-72c5893e4e8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b602762-b866-4e37-8511-72c5893e4e8b', 'volume_size': 1, 'image_id': '7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3ea8e8d441bc71b215e4ae1fc00295e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '882b121f9b784a749d819ce5bbe0ef6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cc8870caacb75b352d272f3974b1e0ed807a4f3715f2949145561916ae7924a1fb7d925e7f01d1bacd15b9a25e202efb657364460ac0a3db13cfaf7c025f366', 'id': '7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'created_at': datetime.datetime(2026, 7, 5, 15, 39, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 39, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Trying to clone 1b602762-b866-4e37-8511-72c5893e4e8b from image 7d8d0d87-ae33-47d3-89ac-b25ece467cce at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:39:28 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 1073741824" returned: 0 in 0.958s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:39:28 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Image download 0.00 MB at 0.00 MB/s Jul 05 17:39:28 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 Jul 05 17:39:28 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbe8e1d-ceca-43d5-be66-5acc803db214]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:28 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD Jul 05 17:39:28 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:29 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22" returned: 0 in 0.712s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.519s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703233475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e494c03a-6d5d-4749-8fc4-dddc343b6f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:24Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Creating volume e494c03a-6d5d-4749-8fc4-dddc343b6f32 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:29 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:29 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 1073741824 Jul 05 17:39:29 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da259f10-e414-41e0-94f7-aaa3e911da13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864680cc-9527-42d9-b0af-5cdb64e3dd22', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2bc665-f321-465b-a85d-879be6d5a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:29 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Volume volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 (864680cc-9527-42d9-b0af-5cdb64e3dd22): created successfully Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2bc665-f321-465b-a85d-879be6d5a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (495d2048-89ad-4b08-ba02-add6ee9da99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-553e1673-9f37-4d0d-8ed3-3449d5dd0a23 tempest-CreateVolumesFromImageTest-563140046 None] Created volume successfully. Jul 05 17:39:29 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:29 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD Jul 05 17:39:29 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:29 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 1073741824" returned: 0 in 0.825s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:29 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD" returned: 1 in 0.737s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Temporary image 7d8d0d87-ae33-47d3-89ac-b25ece467cce is fetched for user 0b2a5ab9a6e44fe6a323b1777ddfbd53. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:39:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:30 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 Jul 05 17:39:30 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd9e39f-0c1c-4566-a80a-624f499d9f88]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:30 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD Jul 05 17:39:30 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:30 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32" returned: 0 in 0.653s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.884s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837195593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44579599-37de-4b19-bebe-fa2de3d46828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:25Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Creating volume 44579599-37de-4b19-bebe-fa2de3d46828 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:30 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:30 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 1073741824 Jul 05 17:39:30 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c788b6e-fb35-47c7-be5a-75d684c234e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69e1042-2a74-4ae6-b113-818c98b312d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:30 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 (e494c03a-6d5d-4749-8fc4-dddc343b6f32): created successfully Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69e1042-2a74-4ae6-b113-818c98b312d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (85644025-548a-40f7-8d51-85f3ea85391f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:30 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9329468b-c5a9-4357-b841-2b5293dbcbdb tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created volume successfully. Jul 05 17:39:30 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:30 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD Jul 05 17:39:30 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:31 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 1073741824" returned: 0 in 0.815s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:31 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 Jul 05 17:39:31 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:31 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD" returned: 1 in 0.754s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:39:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:32 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828" returned: 0 in 0.690s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.186s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230505031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19d27bb-6e3e-410f-b5e5-00db2cbca9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:25Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Creating volume e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:32 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:32 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 1073741824 Jul 05 17:39:32 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ab9265-a3e4-4dca-8a37-ea87c08894d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44579599-37de-4b19-bebe-fa2de3d46828', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cea1e8-9698-4332-89a9-d6d919945fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Volume volume-44579599-37de-4b19-bebe-fa2de3d46828 (44579599-37de-4b19-bebe-fa2de3d46828): created successfully Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cea1e8-9698-4332-89a9-d6d919945fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (f3b6bbef-a658-4f9b-85c5-840d1acbae58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (0b252a4c-7f39-434c-97ab-fd865713be36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b580d-259c-4ca5-bc00-bf2da9e5595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fb749b9d-a439-4849-80aa-de8f6ef90016 tempest-CreateVolumesFromImageTest-563140046 None] Created volume successfully. Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b580d-259c-4ca5-bc00-bf2da9e5595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794655315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6089ef45-c4f4-4b51-81de-4278edfbac99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:32Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a8a419-e25a-4cbd-8d67-eca60b739a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a8a419-e25a-4cbd-8d67-eca60b739a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0abcf2-a4a2-487a-b06b-06adad7c9760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0abcf2-a4a2-487a-b06b-06adad7c9760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6089ef45-c4f4-4b51-81de-4278edfbac99', 'volume_name': 'volume-6089ef45-c4f4-4b51-81de-4278edfbac99', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec60cc42-3d7e-4158-a8fb-67ca338d2bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec60cc42-3d7e-4158-a8fb-67ca338d2bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae80fa7-431e-4bf9-af2a-1031752821cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume 6089ef45-c4f4-4b51-81de-4278edfbac99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6089ef45-c4f4-4b51-81de-4278edfbac99', 'volume_size': 1} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (43bb8983-7243-4138-87fe-26747b99ed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bf9ac5-169e-45cc-a519-68809b6fd24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bf9ac5-169e-45cc-a519-68809b6fd24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073828678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41c1edd-2e41-4fac-b9c1-912ed70ce9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:33Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e7c657-7451-447c-ae96-3786cdaa77b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e7c657-7451-447c-ae96-3786cdaa77b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b15f7c3-b411-4a66-93db-21b00e54c889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b15f7c3-b411-4a66-93db-21b00e54c889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41c1edd-2e41-4fac-b9c1-912ed70ce9e2', 'volume_name': 'volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971b0620-d635-46b0-8b37-4ec728b10d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971b0620-d635-46b0-8b37-4ec728b10d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fef81db-cd43-4fe3-b758-303f74867b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:32 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume b41c1edd-2e41-4fac-b9c1-912ed70ce9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2', 'volume_size': 1} Jul 05 17:39:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (15914baa-73f8-4bd7-ac2a-83cfc2b286db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452ea758-26d1-4911-8f0c-2c7d3c7af447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452ea758-26d1-4911-8f0c-2c7d3c7af447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312606428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:33Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15537b3e-fa1a-4825-bf47-2fe30899e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15537b3e-fa1a-4825-bf47-2fe30899e048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ba58f5-c1a2-4924-a5a1-13be4f7bf10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ba58f5-c1a2-4924-a5a1-13be4f7bf10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1', 'volume_name': 'volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ccfd8a-e15c-4d47-98ae-bb7d92f91c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ccfd8a-e15c-4d47-98ae-bb7d92f91c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538c01bb-e636-4c22-aa97-9e7f2d224adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume 90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1', 'volume_size': 1} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:33 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 1073741824" returned: 0 in 0.999s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:33 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 Jul 05 17:39:33 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (c8d743b7-458b-4382-8017-876d872ceb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930d1d27-aa37-4643-8688-c346d93d5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930d1d27-aa37-4643-8688-c346d93d5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636965107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528342a1-b6fe-4cf1-8927-732ad8337554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:33Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dbc2ac-536d-48d6-9dff-d8753842bc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dbc2ac-536d-48d6-9dff-d8753842bc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ba9031-ddd6-4da2-9e6d-efbb438e3ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ba9031-ddd6-4da2-9e6d-efbb438e3ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '528342a1-b6fe-4cf1-8927-732ad8337554', 'volume_name': 'volume-528342a1-b6fe-4cf1-8927-732ad8337554', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c491e80-19fc-4b26-829f-6c85151db782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c491e80-19fc-4b26-829f-6c85151db782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51909a92-da95-4e74-9519-2d2e43e91465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume 528342a1-b6fe-4cf1-8927-732ad8337554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-528342a1-b6fe-4cf1-8927-732ad8337554', 'volume_size': 1} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (507a3cdb-6056-422b-97d9-db2a23c9508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db98630-bee4-4d4f-9c6b-a2e4254b4ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db98630-bee4-4d4f-9c6b-a2e4254b4ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043427420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6906bf-af92-4e66-bf3d-6dcc371e361f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:34Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a3ef8a-cb7c-4796-9fe1-68de4c0ddc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a3ef8a-cb7c-4796-9fe1-68de4c0ddc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff05bc4-23a4-45d3-bf83-e808344c4f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff05bc4-23a4-45d3-bf83-e808344c4f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b6906bf-af92-4e66-bf3d-6dcc371e361f', 'volume_name': 'volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aeafec5-7b34-4b19-832d-10f01f4723d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aeafec5-7b34-4b19-832d-10f01f4723d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7801d1ef-9f77-44e0-9a71-08037703ea63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:33 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume 2b6906bf-af92-4e66-bf3d-6dcc371e361f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f', 'volume_size': 1} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:33 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8" returned: 0 in 0.704s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.532s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922241195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05da037-b111-442e-b1b1-48fb2ec5ecd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3627cbf41126438694cac5d9b5d69655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:25Z,use_quota=True,user_id='665017eee3294caa9924895183c010a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Creating volume e05da037-b111-442e-b1b1-48fb2ec5ecd3 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:33 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef530e01-8227-439e-93c0-b5f3bf916796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:33 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 1073741824 Jul 05 17:39:33 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77ba1a2-033f-4cd6-9920-e39359c030f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Volume volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 (e19d27bb-6e3e-410f-b5e5-00db2cbca9b8): created successfully Jul 05 17:39:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77ba1a2-033f-4cd6-9920-e39359c030f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (89e15621-b290-4b5e-b3ee-4e6681889881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f302756a-6471-4c81-96c6-701ada9c3c37 tempest-CreateVolumesFromImageTest-563140046 None] Created volume successfully. Jul 05 17:39:34 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 1073741824" returned: 0 in 0.808s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:34 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 Jul 05 17:39:34 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:35 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3" returned: 0 in 0.684s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.551s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1471fdb5-2748-4b9d-9e66-dfa664b84030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e829c5bf-325f-46e3-b40f-dc5f8afaffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Creating offline snapshot 6a30456c-1ab3-4dd2-b03b-22896f47a1d0 of volume a0a9c07a-0af1-43a2-aa6a-bbae088a383b {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:39:35 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Volume volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 (e05da037-b111-442e-b1b1-48fb2ec5ecd3): created successfully Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e829c5bf-325f-46e3-b40f-dc5f8afaffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Flow 'volume_create_manager' (afcabac2-e49d-4766-b781-4117f7b6f9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c6018-f902-44d0-bbd4-ca3c65cf91ea]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:35 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-85d1c299-284a-4750-8c01-b9022ec25fdf tempest-CreateVolumesFromImageTest-563140046 None] Created volume successfully. Jul 05 17:39:35 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b Jul 05 17:39:35 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-e05da037-b111-442e-b1b1-48fb2ec5ecd3-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-e05da037-b111-442e-b1b1-48fb2ec5ecd3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:36 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-quobyte-e05da037-b111-442e-b1b1-48fb2ec5ecd3" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:36 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 1G Jul 05 17:39:36 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-e05da037-b111-442e-b1b1-48fb2ec5ecd3" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:36 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac94be1-7901-4a2e-a331-de443a1c9402]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:36 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 Jul 05 17:39:36 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:37 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 1G" returned: 0 in 0.789s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:37 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 Jul 05 17:39:37 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:37 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3" returned: 0 in 0.825s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:37 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3 Jul 05 17:39:37 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:37 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0" returned: 0 in 0.716s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:37 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 is being set with open permissions: ugo+rw Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:37 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 Jul 05 17:39:37 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:37 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e05da037-b111-442e-b1b1-48fb2ec5ecd3" returned: 0 in 0.684s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-e05da037-b111-442e-b1b1-48fb2ec5ecd3" released by "delete_volume" :: held 1.552s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:37 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Created reservations ['98b3a648-4fe0-45b6-acb7-1d0185c277fc', 'f1c4d954-eaae-444a-ab5e-91a22a6bf02e', '04cd26c6-08f5-458d-b790-29c137c8b19a', 'dbf5dc07-e840-4c32-ac3f-29dad21a4f89'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:38 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:38 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:38 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0" returned: 0 in 0.663s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:38 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.info Jul 05 17:39:38 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-quobyte-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa45af13-0222-4e21-82dd-ccd842707eae]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:38 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.683s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Deleted volume successfully. Jul 05 17:39:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a0ed71c-cb70-41ef-9fc8-86da42ef7e55 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-e05da037-b111-442e-b1b1-48fb2ec5ecd3-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:38 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 Jul 05 17:39:38 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:39 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.info" returned: 0 in 0.710s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:39 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.info is being set with open permissions: ugo+rw Jul 05 17:39:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:39 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.info Jul 05 17:39:39 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:39 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8" returned: 0 in 0.853s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:39 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8 Jul 05 17:39:39 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:40 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.info" returned: 0 in 0.759s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.554s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.492s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b602762-b866-4e37-8511-72c5893e4e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882b121f9b784a749d819ce5bbe0ef6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:28Z,use_quota=True,user_id='0b2a5ab9a6e44fe6a323b1777ddfbd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(999fc8ce-f504-44fd-9e7e-db7aaa6ecba9),volume_type_id=999fc8ce-f504-44fd-9e7e-db7aaa6ecba9)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Creating volume 1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:40 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:40 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b 1073741824 Jul 05 17:39:40 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:40 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d3b05d31-d4f0-4495-9649-bc42f24e0422 tempest-CreateVolumesFromSnapshotTest-531801325 None] Create snapshot completed successfully Jul 05 17:39:40 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8" returned: 0 in 0.717s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8" released by "delete_volume" :: held 1.618s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Created reservations ['8a205e4b-3736-409c-86c5-f46ad4c7df8b', '1d75911c-4bd0-41f9-83e7-0f2bcaf6fcf3', '176f9817-8acc-4e85-8279-75779e219205', '7c8c8a5b-2da5-47ba-bccf-b85edb862f24'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:40 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:40 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-44579599-37de-4b19-bebe-fa2de3d46828-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-44579599-37de-4b19-bebe-fa2de3d46828-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-quobyte-44579599-37de-4b19-bebe-fa2de3d46828" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-44579599-37de-4b19-bebe-fa2de3d46828" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee8ebe2-ee91-43ca-86cd-4f2677507c4b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (c09d0c5e-8d8c-42ff-9ecd-fc973978f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a67e1be-131e-4c78-b014-56ae272eb6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a67e1be-131e-4c78-b014-56ae272eb6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786802147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ff89d6-bceb-4653-a613-41df6397eabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:41Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc1b983-1635-4858-9820-bcc85f5ce739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc1b983-1635-4858-9820-bcc85f5ce739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f45fe1-69e0-4b83-ac94-f016e6d062a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f45fe1-69e0-4b83-ac94-f016e6d062a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ff89d6-bceb-4653-a613-41df6397eabb', 'volume_name': 'volume-87ff89d6-bceb-4653-a613-41df6397eabb', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81900fb-0f02-4c98-b620-383499c3ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81900fb-0f02-4c98-b620-383499c3ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:41 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 Jul 05 17:39:41 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e006e7d6-93ae-48aa-9d8b-7cf569808036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume 87ff89d6-bceb-4653-a613-41df6397eabb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ff89d6-bceb-4653-a613-41df6397eabb', 'volume_size': 1} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:41 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b 1073741824" returned: 0 in 1.159s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:41 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b Jul 05 17:39:41 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:41 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.059s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Deleted volume successfully. Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e19436fa-486b-43c0-bff2-89020627df5a tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-e19d27bb-6e3e-410f-b5e5-00db2cbca9b8-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (0c840386-027a-4341-bb6f-aac491a78657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334c883d-952d-4b15-af1b-0e0941f6cb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334c883d-952d-4b15-af1b-0e0941f6cb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825860718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a909918-8de3-468b-85e4-5296c0725382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:41Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0247307e-1629-412f-9188-9c11fa4f6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0247307e-1629-412f-9188-9c11fa4f6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48568f7-01c8-4abb-91b1-1746fe371d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48568f7-01c8-4abb-91b1-1746fe371d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a909918-8de3-468b-85e4-5296c0725382', 'volume_name': 'volume-7a909918-8de3-468b-85e4-5296c0725382', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28420a90-ae13-4e56-b343-820724f8db5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28420a90-ae13-4e56-b343-820724f8db5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93460d0-6939-4e16-8d0f-6f92d47d70a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:41 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume 7a909918-8de3-468b-85e4-5296c0725382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a909918-8de3-468b-85e4-5296c0725382', 'volume_size': 1} Jul 05 17:39:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:42 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b" returned: 0 in 0.764s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.646s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794655315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6089ef45-c4f4-4b51-81de-4278edfbac99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:32Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Creating volume 6089ef45-c4f4-4b51-81de-4278edfbac99 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:42 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:42 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:42 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 1073741824 Jul 05 17:39:42 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (04ba2450-6072-4f77-bf75-bf7a4ea3109f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebd013b-8455-4e82-9725-e07cdffab7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Attempting download of 7d8d0d87-ae33-47d3-89ac-b25ece467cce ((None, [{'url': 'file:///opt/stack/data/glance/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'metadata': {}}])) to volume 1b602762-b866-4e37-8511-72c5893e4e8b. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828" returned: 0 in 1.154s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:42 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828 Jul 05 17:39:42 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebd013b-8455-4e82-9725-e07cdffab7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-588631145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b21f51-73b7-4a1e-b251-b846eb137346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:42Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31b151b-6a52-420b-943f-1e39e568a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31b151b-6a52-420b-943f-1e39e568a130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe42729-ec3a-411f-843f-7a9ffdd2c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe42729-ec3a-411f-843f-7a9ffdd2c075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b21f51-73b7-4a1e-b251-b846eb137346', 'volume_name': 'volume-89b21f51-73b7-4a1e-b251-b846eb137346', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0005fd0-5253-4a3d-809e-bbffcdc1bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0005fd0-5253-4a3d-809e-bbffcdc1bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638b0d4e-83d0-4ebb-8ece-2e5fbd1be47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume 89b21f51-73b7-4a1e-b251-b846eb137346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b21f51-73b7-4a1e-b251-b846eb137346', 'volume_size': 1} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe7917c-9b7c-4315-92a2-433413fbf86a]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d8d0d87-ae33-47d3-89ac-b25ece467cce_mesmxiey {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:42 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d8d0d87-ae33-47d3-89ac-b25ece467cce_mesmxiey Jul 05 17:39:42 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (c2fc4d80-ed17-44fe-a336-deb6efddaa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ea101a-dbc5-4c21-88af-241e04638d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ea101a-dbc5-4c21-88af-241e04638d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1632314881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beda0680-38f7-4ae5-8a4c-acbf92aefd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:43Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6052c2a-263c-44be-98c9-869eea224aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6052c2a-263c-44be-98c9-869eea224aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9f52bc-9805-4f44-8bec-66386ff11744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9f52bc-9805-4f44-8bec-66386ff11744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beda0680-38f7-4ae5-8a4c-acbf92aefd0c', 'volume_name': 'volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a36676-9f1c-44d2-bdd7-1adf4c50b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a36676-9f1c-44d2-bdd7-1adf4c50b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed2487b-640f-4c5c-a378-a555bbcb6e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume beda0680-38f7-4ae5-8a4c-acbf92aefd0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c', 'volume_size': 1} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (807056ff-fe61-476b-a8b3-26009dce37b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8527bf67-8006-48d7-8f0a-0ea05653dbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8527bf67-8006-48d7-8f0a-0ea05653dbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-881334840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbfc795-b31e-47e8-bace-9ee9eaa0c602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:43Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9799a6f3-a209-45c5-9bb6-ea95c86c6fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9799a6f3-a209-45c5-9bb6-ea95c86c6fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:42 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8e509-c76a-4e76-89db-a534ab22efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8e509-c76a-4e76-89db-a534ab22efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbfc795-b31e-47e8-bace-9ee9eaa0c602', 'volume_name': 'volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6d9ea0-0c32-453d-902d-7dc03e0ce85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6d9ea0-0c32-453d-902d-7dc03e0ce85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca729031-ca98-40bd-a164-f2c7785cf35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:43 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume 2bbfc795-b31e-47e8-bace-9ee9eaa0c602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602', 'volume_size': 1} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:43 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-44579599-37de-4b19-bebe-fa2de3d46828" returned: 0 in 0.975s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-44579599-37de-4b19-bebe-fa2de3d46828" released by "delete_volume" :: held 2.185s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Created reservations ['c1175208-66df-444f-b6b7-305d29e112f3', '8724bc5a-8868-4080-8c43-5e0206b49e6e', 'dad8fe28-492e-4923-9314-5c63fd12fa00', 'da6a6243-666f-485a-99e9-d481ff6ffdaa'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:43 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 1073741824" returned: 0 in 1.145s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:43 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 Jul 05 17:39:43 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:43 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:43 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:43 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d8d0d87-ae33-47d3-89ac-b25ece467cce_mesmxiey" returned: 0 in 0.978s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d8d0d87-ae33-47d3-89ac-b25ece467cce_mesmxiey {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:43 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d8d0d87-ae33-47d3-89ac-b25ece467cce_mesmxiey Jul 05 17:39:43 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:43 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99" returned: 0 in 0.715s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.247s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073828678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41c1edd-2e41-4fac-b9c1-912ed70ce9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:33Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Creating volume b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:43 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:44 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 1073741824 Jul 05 17:39:44 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae80fa7-431e-4bf9-af2a-1031752821cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6089ef45-c4f4-4b51-81de-4278edfbac99', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e8b569-7bc5-41b2-8479-1abe78d06d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:44 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.719s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Deleted volume successfully. Jul 05 17:39:44 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume volume-6089ef45-c4f4-4b51-81de-4278edfbac99 (6089ef45-c4f4-4b51-81de-4278edfbac99): created successfully Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e8b569-7bc5-41b2-8479-1abe78d06d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (0b252a4c-7f39-434c-97ab-fd865713be36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:44 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6f967697-5b15-48b8-aa06-d3480dad36ab tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created volume successfully. Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-25126cac-4ea3-40e1-8356-e1cac2744143 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-44579599-37de-4b19-bebe-fa2de3d46828-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:44 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d8d0d87-ae33-47d3-89ac-b25ece467cce_mesmxiey" returned: 1 in 0.814s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d8d0d87-ae33-47d3-89ac-b25ece467cce_mesmxiey' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[adebb005-2b96-4055-bc79-b6b151fcdd3a]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-864680cc-9527-42d9-b0af-5cdb64e3dd22-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-864680cc-9527-42d9-b0af-5cdb64e3dd22-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-quobyte-864680cc-9527-42d9-b0af-5cdb64e3dd22" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-864680cc-9527-42d9-b0af-5cdb64e3dd22" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dd8846-ffc0-4956-b3dc-2698be536c2e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:44 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD Jul 05 17:39:44 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:44 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 Jul 05 17:39:44 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:44 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 1073741824" returned: 0 in 0.915s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:44 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 Jul 05 17:39:44 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:45 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD" returned: 0 in 0.848s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:45 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD Jul 05 17:39:45 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:45 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22" returned: 0 in 0.881s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:45 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22 Jul 05 17:39:45 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:45 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2" returned: 0 in 0.752s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.576s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312606428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:33Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Creating volume 90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:45 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:45 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD" returned: 1 in 0.704s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] 7d8d0d87-ae33-47d3-89ac-b25ece467cce was raw, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:39:45 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 1073741824 Jul 05 17:39:45 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fef81db-cd43-4fe3-b758-303f74867b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5244c7e3-fdbd-4619-8683-9efd9a0418f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:45 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b Jul 05 17:39:45 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:45 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 (b41c1edd-2e41-4fac-b9c1-912ed70ce9e2): created successfully Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5244c7e3-fdbd-4619-8683-9efd9a0418f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (43bb8983-7243-4138-87fe-26747b99ed7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:45 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-85ba6387-75e9-4a20-bc3e-c80dff1602bc tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created volume successfully. Jul 05 17:39:45 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-864680cc-9527-42d9-b0af-5cdb64e3dd22" returned: 0 in 0.690s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-864680cc-9527-42d9-b0af-5cdb64e3dd22" released by "delete_volume" :: held 1.639s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Created reservations ['a05b2a1e-86be-4cb6-9745-a5bed93631a4', '928da923-a8a1-4c9d-86ae-3393a8afb011', '85424019-6be3-47c8-93f7-0811c865a47a', '99ff414b-c6ab-47d4-8b03-fd4685cec30b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:46 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:46 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-8138185b-0bc3-457b-b617-2b7a5c6f5f94-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-8138185b-0bc3-457b-b617-2b7a5c6f5f94-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:46 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b" returned: 0 in 0.830s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d8d0d87-ae33-47d3-89ac-b25ece467cce_gsz4stgpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:39:46 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:46 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b 1G Jul 05 17:39:46 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "cinder-quobyte-8138185b-0bc3-457b-b617-2b7a5c6f5f94" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-8138185b-0bc3-457b-b617-2b7a5c6f5f94" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:46 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 1073741824" returned: 0 in 0.992s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b3cb5e-1fe3-4294-bfd2-ad520ac9fd03]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:46 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 Jul 05 17:39:46 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:46 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.727s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:46 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Deleted volume successfully. Jul 05 17:39:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c747208e-6f53-427b-97a6-49768b6c6b16 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-864680cc-9527-42d9-b0af-5cdb64e3dd22-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:46 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 Jul 05 17:39:46 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:47 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b 1G" returned: 0 in 0.868s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:47 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1" returned: 0 in 0.691s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.939s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636965107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528342a1-b6fe-4cf1-8927-732ad8337554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:33Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Creating volume 528342a1-b6fe-4cf1-8927-732ad8337554 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:47 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba18b3a-70bd-4ac2-9ab5-7feb7e24d149]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:47 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 1073741824 Jul 05 17:39:47 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538c01bb-e636-4c22-aa97-9e7f2d224adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8173c73d-a610-4321-9f07-b1ae9492be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:47 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 (90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1): created successfully Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8173c73d-a610-4321-9f07-b1ae9492be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (15914baa-73f8-4bd7-ac2a-83cfc2b286db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:47 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94" returned: 0 in 0.849s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2fec81df-5efa-4792-bb52-80755bfe770d tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created volume successfully. Jul 05 17:39:47 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94 Jul 05 17:39:47 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:47 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b Jul 05 17:39:47 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:48 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:48 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 1073741824" returned: 0 in 0.861s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:48 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-8138185b-0bc3-457b-b617-2b7a5c6f5f94" returned: 0 in 0.774s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-quobyte-8138185b-0bc3-457b-b617-2b7a5c6f5f94" released by "delete_volume" :: held 1.706s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:48 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b Jul 05 17:39:48 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:48 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 Jul 05 17:39:48 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Created reservations ['ec391fd9-9342-4821-93c4-2e97dc8e9fe5', '94bd3bde-af3f-4a1c-9059-08671bee19f1', '532b0eb4-f500-46e4-aeb4-83c1bcfff453', '428a22ae-4e55-4528-b2ea-0477ea2cbc40'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:48 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:48 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:49 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554" returned: 0 in 0.797s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.324s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043427420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6906bf-af92-4e66-bf3d-6dcc371e361f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edd672e03d045e796352b37f9c3dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:34Z,use_quota=True,user_id='681ad68bce2d40c5bc048c519bbffce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Creating volume 2b6906bf-af92-4e66-bf3d-6dcc371e361f {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:49 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51909a92-da95-4e74-9519-2d2e43e91465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-528342a1-b6fe-4cf1-8927-732ad8337554', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2d8c95-6247-47f2-840c-3aade1b7991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:49 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f 1073741824 Jul 05 17:39:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume volume-528342a1-b6fe-4cf1-8927-732ad8337554 (528342a1-b6fe-4cf1-8927-732ad8337554): created successfully Jul 05 17:39:49 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2d8c95-6247-47f2-840c-3aade1b7991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (c8d743b7-458b-4382-8017-876d872ceb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:49 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b" returned: 1 in 1.021s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Downloaded image 7d8d0d87-ae33-47d3-89ac-b25ece467cce ((None, [{'url': 'file:///opt/stack/data/glance/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'metadata': {}}])) to volume 1b602762-b866-4e37-8511-72c5893e4e8b successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Temporary image 7d8d0d87-ae33-47d3-89ac-b25ece467cce for user 0b2a5ab9a6e44fe6a323b1777ddfbd53 is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Marking volume 1b602762-b866-4e37-8511-72c5893e4e8b as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:39:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-06cd4987-9156-4c3a-b3dc-3e7763aed708 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created volume successfully. Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Copying metadata from image 7d8d0d87-ae33-47d3-89ac-b25ece467cce to 1b602762-b866-4e37-8511-72c5893e4e8b. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Creating volume glance metadata for volume 1b602762-b866-4e37-8511-72c5893e4e8b backed by image 7d8d0d87-ae33-47d3-89ac-b25ece467cce with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd3ea8e8d441bc71b215e4ae1fc00295e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:39:49 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.846s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Deleted volume successfully. Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a675dd4f-f426-402b-aba1-a182b0721292 tempest-CreateVolumesFromImageTest-563140046 None] Lock "cinder-8138185b-0bc3-457b-b617-2b7a5c6f5f94-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4a4f07-203b-431f-b620-f53374a22ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b602762-b866-4e37-8511-72c5893e4e8b', 'volume_size': 1, 'image_id': '7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3ea8e8d441bc71b215e4ae1fc00295e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '882b121f9b784a749d819ce5bbe0ef6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cc8870caacb75b352d272f3974b1e0ed807a4f3715f2949145561916ae7924a1fb7d925e7f01d1bacd15b9a25e202efb657364460ac0a3db13cfaf7c025f366', 'id': '7d8d0d87-ae33-47d3-89ac-b25ece467cce', 'created_at': datetime.datetime(2026, 7, 5, 15, 39, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 39, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d8d0d87-ae33-47d3-89ac-b25ece467cce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d04fb9a-5d92-452e-b76f-e37f0fe74b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Volume volume-1b602762-b866-4e37-8511-72c5893e4e8b (1b602762-b866-4e37-8511-72c5893e4e8b): created successfully Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d04fb9a-5d92-452e-b76f-e37f0fe74b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Flow 'volume_create_manager' (3aa3cdae-35a7-4112-9493-321821c151a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6a271d77-cbe9-4370-b914-dd91e34a26cb tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Created volume successfully. Jul 05 17:39:50 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f 1073741824" returned: 0 in 1.005s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:50 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Acquiring lock "cinder-1b602762-b866-4e37-8511-72c5893e4e8b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:50 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "cinder-1b602762-b866-4e37-8511-72c5893e4e8b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Acquiring lock "cinder-quobyte-1b602762-b866-4e37-8511-72c5893e4e8b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "cinder-quobyte-1b602762-b866-4e37-8511-72c5893e4e8b" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c3fdf0-d7ad-4c72-8866-5d001524c2b1]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:50 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b Jul 05 17:39:50 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:50 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:50 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:51 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f" returned: 0 in 0.750s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.965s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786802147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ff89d6-bceb-4653-a613-41df6397eabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:41Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Creating volume 87ff89d6-bceb-4653-a613-41df6397eabb {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:51 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:51 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb 1073741824 Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7801d1ef-9f77-44e0-9a71-08037703ea63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:51 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42041b7d-086d-4c3c-8579-20d98716a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:51 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Volume volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f (2b6906bf-af92-4e66-bf3d-6dcc371e361f): created successfully Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42041b7d-086d-4c3c-8579-20d98716a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Flow 'volume_create_manager' (507a3cdb-6056-422b-97d9-db2a23c9508c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:51 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fde575ea-df17-4a14-9ebe-531ff3ec4de6 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created volume successfully. Jul 05 17:39:51 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.033s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:51 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b" returned: 0 in 1.274s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:52 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b Jul 05 17:39:52 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:52 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb 1073741824" returned: 0 in 1.190s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:52 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb Jul 05 17:39:52 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-2b6906bf-af92-4e66-bf3d-6dcc371e361f-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-2b6906bf-af92-4e66-bf3d-6dcc371e361f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-quobyte-2b6906bf-af92-4e66-bf3d-6dcc371e361f" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-2b6906bf-af92-4e66-bf3d-6dcc371e361f" acquired by "delete_volume" :: waited 0.040s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea21f1c-28f3-4f9a-8eef-1e3531ad416d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Flow 'volume_create_manager' (cd4906bf-9d62-494f-9738-3a3ae6ccb5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:52 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a56fdfb-0601-4fe8-85a5-6c48a1de5dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b" returned: 1 in 0.997s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a56fdfb-0601-4fe8-85a5-6c48a1de5dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-68912795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f62906-8964-4b01-81b6-747cf1448235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd250aca093647c5ab0d13ec0ea12f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:53Z,use_quota=True,user_id='9fd6df1011824da9af69130f510dd246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5bdb2d-bdf0-4cb8-b88e-c420e80c0a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:52 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5bdb2d-bdf0-4cb8-b88e-c420e80c0a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:52 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:52 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b Jul 05 17:39:52 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4ff2fe-85d6-40ff-8944-b231cd338126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4ff2fe-85d6-40ff-8944-b231cd338126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f62906-8964-4b01-81b6-747cf1448235', 'volume_name': 'volume-01f62906-8964-4b01-81b6-747cf1448235', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b4067d-42a5-4fca-be77-456ca6bc8a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b4067d-42a5-4fca-be77-456ca6bc8a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a669c26-3435-4869-bab5-ff0860dce3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:52 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Volume 01f62906-8964-4b01-81b6-747cf1448235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f62906-8964-4b01-81b6-747cf1448235', 'volume_size': 1} Jul 05 17:39:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:53 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb" returned: 0 in 0.797s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.612s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825860718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a909918-8de3-468b-85e4-5296c0725382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:41Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Creating volume 7a909918-8de3-468b-85e4-5296c0725382 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:53 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:53 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 1073741824 Jul 05 17:39:53 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e006e7d6-93ae-48aa-9d8b-7cf569808036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ff89d6-bceb-4653-a613-41df6397eabb', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ae436f-b433-4d77-ae9f-cb73156873d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:53 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume volume-87ff89d6-bceb-4653-a613-41df6397eabb (87ff89d6-bceb-4653-a613-41df6397eabb): created successfully Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ae436f-b433-4d77-ae9f-cb73156873d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (c09d0c5e-8d8c-42ff-9ecd-fc973978f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:53 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c21057dc-34e7-41ee-aaee-516d1a4fd3e0 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created volume successfully. Jul 05 17:39:53 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f" returned: 0 in 0.931s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:53 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-1b602762-b866-4e37-8511-72c5893e4e8b" returned: 0 in 0.862s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:53 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f Jul 05 17:39:53 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "cinder-quobyte-1b602762-b866-4e37-8511-72c5893e4e8b" released by "delete_volume" :: held 3.231s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Created reservations ['6145c200-ac87-4638-b99c-f122103595b9', '08e99587-7bdf-4b11-a238-31a407807b5b', 'bf21a8d5-94c1-46a1-9453-588f642f9d4c', '93f1166e-2570-4f03-87fe-710b17618395'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:53 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:53 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:54 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 1073741824" returned: 0 in 0.911s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:54 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 Jul 05 17:39:54 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:54 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2b6906bf-af92-4e66-bf3d-6dcc371e361f" returned: 0 in 0.708s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-2b6906bf-af92-4e66-bf3d-6dcc371e361f" released by "delete_volume" :: held 1.698s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created reservations ['d9a04e77-80a1-4daf-97ed-b4c5da90dc26', 'bcdc8737-5bb0-435c-a1e1-cffd70dd7c3f', '4fd37abf-edf5-4729-a3ca-0edcc7fa331b', '81b7665b-7298-45dc-b436-ee24d4b63df9'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:54 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:54 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:54 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.724s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Deleted volume successfully. Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef67d606-862f-4369-b46b-70c6e728be4d tempest-VolumeAndVolumeTypeFromImageTest-871865659 None] Lock "cinder-1b602762-b866-4e37-8511-72c5893e4e8b-delete_volume" released by "delete_volume" :: held 4.243s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:54 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382" returned: 0 in 0.666s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.533s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-588631145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b21f51-73b7-4a1e-b251-b846eb137346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:42Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Creating volume 89b21f51-73b7-4a1e-b251-b846eb137346 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:54 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93460d0-6939-4e16-8d0f-6f92d47d70a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a909918-8de3-468b-85e4-5296c0725382', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:54 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 1073741824 Jul 05 17:39:54 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e0f3eb-4900-48e4-b574-43b4c79e043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-528342a1-b6fe-4cf1-8927-732ad8337554-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:54 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume volume-7a909918-8de3-468b-85e4-5296c0725382 (7a909918-8de3-468b-85e4-5296c0725382): created successfully Jul 05 17:39:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e0f3eb-4900-48e4-b574-43b4c79e043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (0c840386-027a-4341-bb6f-aac491a78657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-528342a1-b6fe-4cf1-8927-732ad8337554-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a023d552-5ff0-43e0-ab5b-11814f7f0530 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created volume successfully. Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-quobyte-528342a1-b6fe-4cf1-8927-732ad8337554" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-528342a1-b6fe-4cf1-8927-732ad8337554" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[840cc728-263e-44ce-b88a-5c6b7247e4c2]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:55 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 Jul 05 17:39:55 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:55 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.839s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Deleted volume successfully. Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c1a568a-7c4a-4fea-ace6-60b1da72929f tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-2b6906bf-af92-4e66-bf3d-6dcc371e361f-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:55 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 1073741824" returned: 0 in 1.034s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:55 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 Jul 05 17:39:55 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:56 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554" returned: 0 in 0.965s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:56 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554 Jul 05 17:39:56 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:56 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346" returned: 0 in 0.718s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.869s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1632314881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beda0680-38f7-4ae5-8a4c-acbf92aefd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:43Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Creating volume beda0680-38f7-4ae5-8a4c-acbf92aefd0c {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:56 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638b0d4e-83d0-4ebb-8ece-2e5fbd1be47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b21f51-73b7-4a1e-b251-b846eb137346', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:56 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c 1073741824 Jul 05 17:39:56 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf01b14-6c3d-48d7-8575-fc24f8dc4285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:56 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume volume-89b21f51-73b7-4a1e-b251-b846eb137346 (89b21f51-73b7-4a1e-b251-b846eb137346): created successfully Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf01b14-6c3d-48d7-8575-fc24f8dc4285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (04ba2450-6072-4f77-bf75-bf7a4ea3109f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:56 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9f5a28d2-387c-4de6-994d-5431ba25c048 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created volume successfully. Jul 05 17:39:56 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-528342a1-b6fe-4cf1-8927-732ad8337554" returned: 0 in 0.695s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-528342a1-b6fe-4cf1-8927-732ad8337554" released by "delete_volume" :: held 1.722s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created reservations ['cee9a72a-2fb1-4989-bee3-07395be4b4c2', 'e99b812f-7299-4e21-984f-78db183297f5', 'b3adf85b-8912-4c0a-a50b-cb859317bd22', '2fa92b1b-911f-4bf1-bd0b-b9fda571eee6'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:57 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:57 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-quobyte-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d6a1c3-2a89-45b7-9f85-72111efb25ef]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:57 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 Jul 05 17:39:57 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:57 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c 1073741824" returned: 0 in 1.054s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:57 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c Jul 05 17:39:57 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:57 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.894s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:39:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Deleted volume successfully. Jul 05 17:39:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d2bbcbd3-3599-4292-ba6a-6d7714838519 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-528342a1-b6fe-4cf1-8927-732ad8337554-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:58 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1" returned: 0 in 0.974s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:58 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1 Jul 05 17:39:58 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:58 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c" returned: 0 in 0.778s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.564s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-881334840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbfc795-b31e-47e8-bace-9ee9eaa0c602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1bb16a73d34b9da5766d9ddf4a93df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:43Z,use_quota=True,user_id='1ce4bef58dd24924b4158067f640b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Creating volume 2bbfc795-b31e-47e8-bace-9ee9eaa0c602 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:39:58 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed2487b-640f-4c5c-a378-a555bbcb6e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:58 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 1073741824 Jul 05 17:39:58 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1bd5690-0c09-4288-b4b2-5910703c5274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:39:58 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c (beda0680-38f7-4ae5-8a4c-acbf92aefd0c): created successfully Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1bd5690-0c09-4288-b4b2-5910703c5274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:39:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (c2fc4d80-ed17-44fe-a336-deb6efddaa3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:39:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f39da162-1a8e-427c-ab53-bef8dd339905 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created volume successfully. Jul 05 17:39:59 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1" returned: 0 in 0.742s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1" released by "delete_volume" :: held 1.767s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created reservations ['4a5c3654-a7d2-4665-abf6-947a40eea368', '9a84ad8d-7158-4ce4-a947-835ef1428c20', '0e1b243d-a2bd-435c-baa3-659ce15a4785', '9c0f11a0-32c5-4f22-939e-82ebe9cc2351'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:59 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:39:59 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:59 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 1073741824" returned: 0 in 0.985s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-quobyte-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:39:59 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 Jul 05 17:39:59 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f54dfc-6b07-4b6d-94bf-eabef002849a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:39:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:39:59 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 Jul 05 17:39:59 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:00 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.791s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Deleted volume successfully. Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-51d591e3-f807-42da-a06f-e00d4f0a9cb4 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-90ce88b9-b4f5-4ecd-b9c0-76ee4ecafab1-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Flow 'volume_create_manager' (cced8f81-e5e2-4e1d-bfb4-775504fd6fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf91b35-904d-4152-89e0-1a15561c00a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf91b35-904d-4152-89e0-1a15561c00a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b9b025-a40a-4086-b90a-0ceb6135d76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db5e57a54a4b11a5979955077b9f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:00Z,use_quota=True,user_id='d1d88ee11709429197f1c85f3ae17c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9acac97-6dc8-4b57-94c2-8fc28e67cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9acac97-6dc8-4b57-94c2-8fc28e67cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1284229-1083-41b4-9cb3-4727bdb5c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1284229-1083-41b4-9cb3-4727bdb5c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b9b025-a40a-4086-b90a-0ceb6135d76d', 'volume_name': 'volume-06b9b025-a40a-4086-b90a-0ceb6135d76d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2440be-8633-4d2d-9b58-77e0ca845546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2440be-8633-4d2d-9b58-77e0ca845546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07bfade-d1fa-4cba-9a20-2b4ce79286b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:00 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Volume 06b9b025-a40a-4086-b90a-0ceb6135d76d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b9b025-a40a-4086-b90a-0ceb6135d76d', 'volume_size': 1} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:00 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602" returned: 0 in 0.814s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.486s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-68912795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f62906-8964-4b01-81b6-747cf1448235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd250aca093647c5ab0d13ec0ea12f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:39:53Z,use_quota=True,user_id='9fd6df1011824da9af69130f510dd246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Creating volume 01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:40:00 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca729031-ca98-40bd-a164-f2c7785cf35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fba8f67-e09a-4fb7-b0ed-6a2c99b7eccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:00 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 1073741824 Jul 05 17:40:00 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:00 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Volume volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 (2bbfc795-b31e-47e8-bace-9ee9eaa0c602): created successfully Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fba8f67-e09a-4fb7-b0ed-6a2c99b7eccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Flow 'volume_create_manager' (807056ff-fe61-476b-a8b3-26009dce37b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-68b30a7d-9599-465a-bc29-79977c6b6a3e tempest-CreateVolumesFromSnapshotTest-531801325 None] Created volume successfully. Jul 05 17:40:00 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2" returned: 0 in 0.846s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:00 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2 Jul 05 17:40:00 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:01 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2" returned: 0 in 0.657s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2" released by "delete_volume" :: held 1.557s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created reservations ['780ee112-9fc0-43ab-8702-e9538f43bec6', '78be617a-363d-448b-949a-9dbb8783430a', '8f3d8f7d-47ed-4085-89ab-27b71ae6e921', '64c47c59-c9f2-4706-82e8-8ebde4591439'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:01 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 1073741824" returned: 0 in 0.893s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:01 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:01 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:01 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 Jul 05 17:40:01 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-2bbfc795-b31e-47e8-bace-9ee9eaa0c602-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-2bbfc795-b31e-47e8-bace-9ee9eaa0c602-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-quobyte-2bbfc795-b31e-47e8-bace-9ee9eaa0c602" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-2bbfc795-b31e-47e8-bace-9ee9eaa0c602" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ff89a-e35e-4c9b-b4ac-ee360d197568]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-6089ef45-c4f4-4b51-81de-4278edfbac99-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-6089ef45-c4f4-4b51-81de-4278edfbac99-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:01 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 Jul 05 17:40:01 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-quobyte-6089ef45-c4f4-4b51-81de-4278edfbac99" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-6089ef45-c4f4-4b51-81de-4278edfbac99" acquired by "delete_volume" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[af45130a-acf2-4b29-aef3-d04f15b6df98]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:02 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 Jul 05 17:40:02 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:02 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235" returned: 0 in 0.762s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:02 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b9b025-a40a-4086-b90a-0ceb6135d76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db5e57a54a4b11a5979955077b9f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:00Z,use_quota=True,user_id='d1d88ee11709429197f1c85f3ae17c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Creating volume 06b9b025-a40a-4086-b90a-0ceb6135d76d {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:40:02 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.851s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a669c26-3435-4869-bab5-ff0860dce3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f62906-8964-4b01-81b6-747cf1448235', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:02 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d 1073741824 Jul 05 17:40:02 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e733e5a-8c28-4916-ba37-f6bb4f894618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:02 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Deleted volume successfully. Jul 05 17:40:02 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Volume volume-01f62906-8964-4b01-81b6-747cf1448235 (01f62906-8964-4b01-81b6-747cf1448235): created successfully Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e733e5a-8c28-4916-ba37-f6bb4f894618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Flow 'volume_create_manager' (cd4906bf-9d62-494f-9738-3a3ae6ccb5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:02 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f9644cb2-52fa-4998-8a22-df5dde01fc08 tempest-VolumeDependencyTests-1576368502 None] Created volume successfully. Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5661e64a-c82f-4677-80cf-fba43b35d438 tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-b41c1edd-2e41-4fac-b9c1-912ed70ce9e2-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:02 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602" returned: 0 in 0.872s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:02 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602 Jul 05 17:40:02 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:02 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99" returned: 0 in 0.983s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:02 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99 Jul 05 17:40:02 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:03 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d 1073741824" returned: 0 in 1.039s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:03 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d Jul 05 17:40:03 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:03 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2bbfc795-b31e-47e8-bace-9ee9eaa0c602" returned: 0 in 0.760s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-2bbfc795-b31e-47e8-bace-9ee9eaa0c602" released by "delete_volume" :: held 1.686s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created reservations ['18ad4128-bcb0-4341-a239-131cc8e5a601', 'deda1eec-8f7e-4568-8caa-44157e75b1b8', 'ac6c4485-2928-4b2b-bff8-48856cd492cc', 'c03446c3-20a4-4bbb-a925-638f2c0a0acb'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:03 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:03 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:03 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6089ef45-c4f4-4b51-81de-4278edfbac99" returned: 0 in 0.672s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-6089ef45-c4f4-4b51-81de-4278edfbac99" released by "delete_volume" :: held 1.705s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created reservations ['67242c8f-f799-4764-bfa6-05e895fe4939', '91cbf9ff-767f-4705-8b66-6d98cd60740c', 'fce051db-484b-44d7-b2c5-8db799c82bbb', '98a98403-ac2e-4cc8-96a1-0a207379c5a0'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:03 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:03 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-beda0680-38f7-4ae5-8a4c-acbf92aefd0c-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-beda0680-38f7-4ae5-8a4c-acbf92aefd0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-quobyte-beda0680-38f7-4ae5-8a4c-acbf92aefd0c" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-beda0680-38f7-4ae5-8a4c-acbf92aefd0c" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2d1f3a-d019-4ede-9b52-dfe02f82c054]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-e494c03a-6d5d-4749-8fc4-dddc343b6f32-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-e494c03a-6d5d-4749-8fc4-dddc343b6f32-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:04 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "cinder-quobyte-e494c03a-6d5d-4749-8fc4-dddc343b6f32" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d" returned: 0 in 0.890s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.451s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:04 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c Jul 05 17:40:04 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-e494c03a-6d5d-4749-8fc4-dddc343b6f32" acquired by "delete_volume" :: waited 0.047s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Creating offline snapshot 06099158-e3f1-40cf-a88f-c16f39088cb3 of volume 01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07bfade-d1fa-4cba-9a20-2b4ce79286b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b9b025-a40a-4086-b90a-0ceb6135d76d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0005482-99ec-41a0-8121-5782102475f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7df8826-4d12-4d30-82a2-7343b9be5293]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36adad4-694f-4657-b8ef-613283c6f002]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:04 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Volume volume-06b9b025-a40a-4086-b90a-0ceb6135d76d (06b9b025-a40a-4086-b90a-0ceb6135d76d): created successfully Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0005482-99ec-41a0-8121-5782102475f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Flow 'volume_create_manager' (cced8f81-e5e2-4e1d-bfb4-775504fd6fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:04 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-15f56714-4dd3-4c4d-81ed-dd5443f1119c tempest-CinderUnicodeTest-1192312622 None] Created volume successfully. Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.948s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Deleted volume successfully. Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-79e70fc3-0e09-4990-a145-7a4b2d34ee49 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-2bbfc795-b31e-47e8-bace-9ee9eaa0c602-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:04 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 Jul 05 17:40:04 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:04 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 Jul 05 17:40:04 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:04 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.077s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Deleted volume successfully. Jul 05 17:40:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d213ddae-0a7e-4dee-ba17-127a30f0a80e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-6089ef45-c4f4-4b51-81de-4278edfbac99-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:05 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c" returned: 0 in 0.999s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:05 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c Jul 05 17:40:05 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:40:05 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Flow 'volume_create_manager' (3d7bd32c-5a89-4968-ae3d-d14facd5f914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4d3391-fd8b-4f5b-bcc9-c03b0e9aa785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32" returned: 0 in 1.111s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:05 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:05 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32 Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4d3391-fd8b-4f5b-bcc9-c03b0e9aa785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-717479808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55479892-329c-4544-800d-1db84317f3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db5e57a54a4b11a5979955077b9f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:05Z,use_quota=True,user_id='d1d88ee11709429197f1c85f3ae17c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:05 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564bb7d0-b8e2-4952-83fa-7dc4e256ed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564bb7d0-b8e2-4952-83fa-7dc4e256ed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cbe23f-3015-45a7-9b3b-0f510696cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cbe23f-3015-45a7-9b3b-0f510696cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55479892-329c-4544-800d-1db84317f3f0', 'volume_name': 'volume-55479892-329c-4544-800d-1db84317f3f0', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfb1b02-934a-41cb-a716-7db5866d0d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfb1b02-934a-41cb-a716-7db5866d0d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb35b93-10bb-458c-b056-99cffb08f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:05 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Volume 55479892-329c-4544-800d-1db84317f3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55479892-329c-4544-800d-1db84317f3f0', 'volume_size': 1} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235" returned: 0 in 1.162s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:05 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 1G Jul 05 17:40:05 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:05 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-beda0680-38f7-4ae5-8a4c-acbf92aefd0c" returned: 0 in 0.771s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-beda0680-38f7-4ae5-8a4c-acbf92aefd0c" released by "delete_volume" :: held 1.838s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created reservations ['00409432-7c70-4dcd-a175-fb4af930985e', 'b859aff7-1f52-46ba-951b-4c2a916eda53', 'bda5c3f7-98fa-43b4-9078-22d221b776c6', '5b945bfa-23fa-447b-81a8-84c4a4703c38'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:05 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:05 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:06 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e494c03a-6d5d-4749-8fc4-dddc343b6f32" returned: 0 in 0.687s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-quobyte-e494c03a-6d5d-4749-8fc4-dddc343b6f32" released by "delete_volume" :: held 1.912s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Created reservations ['862fd851-5c0b-4bb8-bf84-2cf63a2bab67', '8117456a-aafa-4836-b5f2-d6dabb7c2203', '69a29590-3426-4b6f-bc22-91e1c69f66fa', '5e77f4af-0c56-4db6-a2fa-378d7a343740'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-89b21f51-73b7-4a1e-b251-b846eb137346-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-89b21f51-73b7-4a1e-b251-b846eb137346-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-quobyte-89b21f51-73b7-4a1e-b251-b846eb137346" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-89b21f51-73b7-4a1e-b251-b846eb137346" acquired by "delete_volume" :: waited 0.051s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:06 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:06 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd2b91-2e2c-457f-af9a-617d57d3c82d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:06 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 1G" returned: 0 in 1.051s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f62906-8964-4b01-81b6-747cf1448235 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:06 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 Jul 05 17:40:06 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:06 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f62906-8964-4b01-81b6-747cf1448235 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 Jul 05 17:40:06 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:06 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.996s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Deleted volume successfully. Jul 05 17:40:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7a44bb01-161f-49c4-adfe-d28c92bdf223 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-beda0680-38f7-4ae5-8a4c-acbf92aefd0c-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:07 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.761s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:07 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Deleted volume successfully. Jul 05 17:40:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6440a6c7-aa37-4f4a-b30f-c6e4d5aa964e tempest-CreateVolumesFromSourceVolumeTest-398632113 None] Lock "cinder-e494c03a-6d5d-4749-8fc4-dddc343b6f32-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:07 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f62906-8964-4b01-81b6-747cf1448235 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3" returned: 0 in 0.954s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:07 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 is being set with open permissions: ugo+rw Jul 05 17:40:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:07 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346" returned: 0 in 1.106s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:07 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 Jul 05 17:40:07 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:07 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346 Jul 05 17:40:07 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:08 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3" returned: 0 in 0.723s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:08 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-89b21f51-73b7-4a1e-b251-b846eb137346" returned: 0 in 0.764s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:08 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.info Jul 05 17:40:08 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-89b21f51-73b7-4a1e-b251-b846eb137346" released by "delete_volume" :: held 1.935s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created reservations ['7bf28771-e1e4-4cfa-a267-411f76e6634d', '07a3f6e8-94ce-4b08-9906-2b32ef63cf21', '4dd46ccd-f45c-4ec5-8b29-ab78b8ccfd3f', '5749061d-5038-4879-844e-603c851ce2d0'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:08 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:08 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-7a909918-8de3-468b-85e4-5296c0725382-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-7a909918-8de3-468b-85e4-5296c0725382-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-quobyte-7a909918-8de3-468b-85e4-5296c0725382" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-7a909918-8de3-468b-85e4-5296c0725382" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[41365831-910e-482e-a679-5b9f630254a7]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:08 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 Jul 05 17:40:08 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:09 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.info" returned: 0 in 0.787s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:09 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.info is being set with open permissions: ugo+rw Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:09 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.info Jul 05 17:40:09 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:09 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.817s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Deleted volume successfully. Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8f6ac1ad-2e73-4c0c-9ba4-145a15e9dae9 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-89b21f51-73b7-4a1e-b251-b846eb137346-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:09 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382" returned: 0 in 0.868s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:09 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382 Jul 05 17:40:09 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:09 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.info" returned: 0 in 0.773s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.670s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.373s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-717479808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55479892-329c-4544-800d-1db84317f3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db5e57a54a4b11a5979955077b9f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:05Z,use_quota=True,user_id='d1d88ee11709429197f1c85f3ae17c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Creating volume 55479892-329c-4544-800d-1db84317f3f0 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:40:09 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:40:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:09 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 1073741824 Jul 05 17:40:09 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-828db29d-6a99-410a-8fc0-a61bb7943e60 tempest-VolumeDependencyTests-1576368502 None] Create snapshot completed successfully Jul 05 17:40:10 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7a909918-8de3-468b-85e4-5296c0725382" returned: 0 in 0.854s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-7a909918-8de3-468b-85e4-5296c0725382" released by "delete_volume" :: held 1.775s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created reservations ['1d9b1294-67bc-4a33-b5bd-8bf02699a672', 'de8040cb-7d11-4f5d-a0e4-77fd79d82362', '22542945-7758-4dbb-a1c1-085c61f5e0d9', 'a620da38-7bde-4503-a9db-eb22ffa5780e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:10 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:10 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-87ff89d6-bceb-4653-a613-41df6397eabb-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-87ff89d6-bceb-4653-a613-41df6397eabb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:40:10 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Flow 'volume_create_manager' (17f4c766-110e-4764-9974-bcf018e53504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acacff87-024f-477e-98b5-977747d931c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 1073741824" returned: 0 in 1.143s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acacff87-024f-477e-98b5-977747d931c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-157674546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccc0b14-a6c6-4957-b085-4a5a7feff1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd250aca093647c5ab0d13ec0ea12f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06099158-e3f1-40cf-a88f-c16f39088cb3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:11Z,use_quota=True,user_id='9fd6df1011824da9af69130f510dd246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe7a5e2-9009-4aa4-a2b9-ebf4b4f7fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe7a5e2-9009-4aa4-a2b9-ebf4b4f7fe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86da498-da43-4f75-aa8d-ee082266011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86da498-da43-4f75-aa8d-ee082266011c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fccc0b14-a6c6-4957-b085-4a5a7feff1bc', 'volume_name': 'volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc', 'volume_size': 1, 'snapshot_id': '06099158-e3f1-40cf-a88f-c16f39088cb3'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e1e6fc-5580-4673-98cf-f9c97bdad473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e1e6fc-5580-4673-98cf-f9c97bdad473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73c67ab-a9a3-4d4c-8d32-56314648952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:11 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Volume fccc0b14-a6c6-4957-b085-4a5a7feff1bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc', 'volume_size': 1, 'snapshot_id': '06099158-e3f1-40cf-a88f-c16f39088cb3'} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-quobyte-87ff89d6-bceb-4653-a613-41df6397eabb" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-87ff89d6-bceb-4653-a613-41df6397eabb" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcdd269-59ac-4c74-b4ac-9ad4eb54def3]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:11 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 Jul 05 17:40:11 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:11 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb Jul 05 17:40:11 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:11 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.863s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Deleted volume successfully. Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0caf946f-d6ae-4a6b-b0bf-695c0366b777 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-7a909918-8de3-468b-85e4-5296c0725382-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:11 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0" returned: 0 in 0.809s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.892s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-quobyte-06099158-e3f1-40cf-a88f-c16f39088cb3-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb35b93-10bb-458c-b056-99cffb08f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55479892-329c-4544-800d-1db84317f3f0', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d23f83-d9c3-4fde-895d-b0f4cf5ad874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-06099158-e3f1-40cf-a88f-c16f39088cb3-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Creating volume fccc0b14-a6c6-4957-b085-4a5a7feff1bc from snapshot 06099158-e3f1-40cf-a88f-c16f39088cb3 {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-quobyte-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:12 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Volume volume-55479892-329c-4544-800d-1db84317f3f0 (55479892-329c-4544-800d-1db84317f3f0): created successfully Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d23f83-d9c3-4fde-895d-b0f4cf5ad874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Flow 'volume_create_manager' (3d7bd32c-5a89-4968-ae3d-d14facd5f914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] snapshot: 06099158-e3f1-40cf-a88f-c16f39088cb3, volume: fccc0b14-a6c6-4957-b085-4a5a7feff1bc, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:40:12 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-44fc2cb6-984f-4886-a4e6-3db32828da4f tempest-CinderUnicodeTest-1192312622 None] Created volume successfully. Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb" returned: 0 in 0.990s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3016e8c8-935e-4c16-b588-7418857171dd]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:12 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb Jul 05 17:40:12 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:12 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 Jul 05 17:40:12 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:12 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-87ff89d6-bceb-4653-a613-41df6397eabb" returned: 0 in 0.696s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-87ff89d6-bceb-4653-a613-41df6397eabb" released by "delete_volume" :: held 1.735s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created reservations ['e47c224d-cc12-4387-bfa9-51c2efa77754', 'a4f3ee56-ad0f-48c5-abd2-811745c4820c', 'c1be5ba7-0f2d-404a-bf1c-4bf85f6771e6', '56a2a675-f23c-44a4-ab7e-5be7acefccca'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:12 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3" returned: 0 in 0.844s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01f62906-8964-4b01-81b6-747cf1448235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:40:12 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8421d4a3-82fe-4f83-ab6c-ec3e2996a8cd]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:12 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-6a30456c-1ab3-4dd2-b03b-22896f47a1d0-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-6a30456c-1ab3-4dd2-b03b-22896f47a1d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-quobyte-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:13 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 Jul 05 17:40:13 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-quobyte-6a30456c-1ab3-4dd2-b03b-22896f47a1d0" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-6a30456c-1ab3-4dd2-b03b-22896f47a1d0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Deleting offline snapshot 6a30456c-1ab3-4dd2-b03b-22896f47a1d0 of volume a0a9c07a-0af1-43a2-aa6a-bbae088a383b {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] snapshot_file for this snap is: volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c6679-9eec-4d73-ba86-2bdd37ff7a60]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:13 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 Jul 05 17:40:13 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:13 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.759s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:13 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Deleted volume successfully. Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7d4a4e11-d68a-43ad-8484-c5b7467438d5 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-87ff89d6-bceb-4653-a613-41df6397eabb-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:13 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235" returned: 0 in 0.953s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:40:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:13 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc Jul 05 17:40:13 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:14 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0" returned: 0 in 0.973s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:40:14 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6091604a-fc72-4ae4-a817-801271ab8f66]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:14 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b Jul 05 17:40:14 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:15 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" returned: 0 in 1.016s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:15 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 Jul 05 17:40:15 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:16 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0" returned: 0 in 1.541s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:16 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0 Jul 05 17:40:16 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:18 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b.6a30456c-1ab3-4dd2-b03b-22896f47a1d0" returned: 0 in 1.513s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-6a30456c-1ab3-4dd2-b03b-22896f47a1d0" released by "_delete_snapshot" :: held 5.249s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" released by "delete_snapshot" :: held 5.296s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:18 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created reservations ['e9e302a1-be20-44a8-a105-3fa0ff9634f1', 'ad6b3753-5862-4a3a-934e-3d3ee3a07198', '15891802-60ed-45a5-8e83-a7b1eaf617e8', '5b59e9f4-1c29-46b5-be98-47e6125fcffa'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Delete snapshot completed successfully. Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-00701b1d-3f5f-4492-a8e4-a06f1c6697b2 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-6a30456c-1ab3-4dd2-b03b-22896f47a1d0-delete_snapshot" released by "delete_snapshot" :: held 5.921s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:19 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" returned: 0 in 5.543s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce41c4d-0283-45c7-8d38-a40e611deacf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:19 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 Jul 05 17:40:19 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-a0a9c07a-0af1-43a2-aa6a-bbae088a383b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-a0a9c07a-0af1-43a2-aa6a-bbae088a383b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "cinder-quobyte-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd19512-7a4b-4bb5-a07d-8acbbfb408a6]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:20 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b Jul 05 17:40:20 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:20 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235" returned: 0 in 1.002s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:20 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:40:20 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Converted 1024.00 MB image at 184.72 MB/s Jul 05 17:40:20 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc is being set with open permissions: ugo+rw Jul 05 17:40:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:20 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc Jul 05 17:40:20 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:20 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" returned: 0 in 0.803s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:20 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b Jul 05 17:40:20 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:21 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" returned: 0 in 0.660s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" released by "_copy_volume_from_snapshot" :: held 9.137s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-06099158-e3f1-40cf-a88f-c16f39088cb3-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" released by "_create_volume_from_snapshot" :: held 9.195s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.237s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.906s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Creating offline snapshot d298e695-483e-4273-b76c-dd69c124cd61 of volume 55479892-329c-4544-800d-1db84317f3f0 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad04b6e4-68d6-4f9f-a0d4-b424b4dc0dd1]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:21 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 Jul 05 17:40:21 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:21 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" returned: 0 in 0.700s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-quobyte-a0a9c07a-0af1-43a2-aa6a-bbae088a383b" released by "delete_volume" :: held 1.571s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=215,cinder:SELECT=153,cinder:INSERT=54,cinder:DELETE=12 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73c67ab-a9a3-4d4c-8d32-56314648952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc', 'volume_size': 1, 'snapshot_id': '06099158-e3f1-40cf-a88f-c16f39088cb3'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984e44ec-db9e-4c58-8989-7e6b4f38ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:21 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Volume volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc (fccc0b14-a6c6-4957-b085-4a5a7feff1bc): created successfully Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984e44ec-db9e-4c58-8989-7e6b4f38ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Flow 'volume_create_manager' (17f4c766-110e-4764-9974-bcf018e53504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Created reservations ['d5a2e26c-71ac-486f-a9d7-3bc23f9cc4c4', '6d124298-640e-469e-b126-deca9064b15e', 'bb1ced8d-bd40-4b66-b375-589783b73b12', '0389c234-8816-4abd-9acd-8b8d0073aea7'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:21 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d30ab964-1558-480d-aabb-913ef93026ed tempest-VolumeDependencyTests-1576368502 None] Created volume successfully. Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:21 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:21 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-06099158-e3f1-40cf-a88f-c16f39088cb3-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-06099158-e3f1-40cf-a88f-c16f39088cb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-quobyte-01f62906-8964-4b01-81b6-747cf1448235" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-01f62906-8964-4b01-81b6-747cf1448235" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-quobyte-06099158-e3f1-40cf-a88f-c16f39088cb3" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:22 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0" returned: 0 in 0.903s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-06099158-e3f1-40cf-a88f-c16f39088cb3" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:22 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 1G Jul 05 17:40:22 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Deleting offline snapshot 06099158-e3f1-40cf-a88f-c16f39088cb3 of volume 01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] snapshot_file for this snap is: volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa3072-e6c9-4262-8f8a-45144851821e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:22 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 Jul 05 17:40:22 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:22 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.790s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:22 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Deleted volume successfully. Jul 05 17:40:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-95a96906-f610-40d8-9687-e185547b6838 tempest-CreateVolumesFromSnapshotTest-531801325 None] Lock "cinder-a0a9c07a-0af1-43a2-aa6a-bbae088a383b-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:23 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3" returned: 0 in 0.876s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01f62906-8964-4b01-81b6-747cf1448235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:40:23 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e2ca24-d818-4d29-addf-608c0effc0b5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:23 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 1G" returned: 0 in 1.046s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55479892-329c-4544-800d-1db84317f3f0 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:23 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55479892-329c-4544-800d-1db84317f3f0 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 Jul 05 17:40:23 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:23 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 Jul 05 17:40:23 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:24 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235" returned: 0 in 0.960s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:24 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 Jul 05 17:40:24 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:24 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55479892-329c-4544-800d-1db84317f3f0 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61" returned: 0 in 0.987s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:24 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 is being set with open permissions: ugo+rw Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:24 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 Jul 05 17:40:24 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:24 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61" returned: 0 in 0.701s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=156,cinder:UPDATE=224,cinder:INSERT=55,cinder:DELETE=29 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:24 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.info Jul 05 17:40:24 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:24 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3" returned: 0 in 0.881s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:25 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3 Jul 05 17:40:25 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:25 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:25 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235.06099158-e3f1-40cf-a88f-c16f39088cb3" returned: 0 in 0.740s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.info" returned: 0 in 0.786s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:25 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.info is being set with open permissions: ugo+rw Jul 05 17:40:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:25 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.info Jul 05 17:40:25 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-06099158-e3f1-40cf-a88f-c16f39088cb3" released by "_delete_snapshot" :: held 3.620s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-01f62906-8964-4b01-81b6-747cf1448235" released by "delete_snapshot" :: held 3.675s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:25 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Created reservations ['f8f2cae9-dabf-46b7-9082-3055d6c83bc0', '4d4ad511-ec26-407e-ac70-d78c36d36f3f', '6ddce6ce-f537-4c5a-8275-ac0be14ae296', '87633a8f-b925-44aa-99bc-ca928000baf7'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Delete snapshot completed successfully. Jul 05 17:40:25 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-765a9c7c-41de-4c36-9e66-356d23deb2a9 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-06099158-e3f1-40cf-a88f-c16f39088cb3-delete_snapshot" released by "delete_snapshot" :: held 3.878s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-01f62906-8964-4b01-81b6-747cf1448235-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-01f62906-8964-4b01-81b6-747cf1448235-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-quobyte-01f62906-8964-4b01-81b6-747cf1448235" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:26 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-01f62906-8964-4b01-81b6-747cf1448235" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.info" returned: 0 in 0.855s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.405s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:26 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e1e8a-482d-4f72-abbe-da10e40f94cf]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:26 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2e734afc-7023-4b7b-8888-0db66685ed5f tempest-CinderUnicodeTest-1192312622 None] Create snapshot completed successfully Jul 05 17:40:26 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 Jul 05 17:40:26 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "cinder-d298e695-483e-4273-b76c-dd69c124cd61-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-d298e695-483e-4273-b76c-dd69c124cd61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "cinder-quobyte-55479892-329c-4544-800d-1db84317f3f0" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-quobyte-55479892-329c-4544-800d-1db84317f3f0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "cinder-quobyte-d298e695-483e-4273-b76c-dd69c124cd61" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-quobyte-d298e695-483e-4273-b76c-dd69c124cd61" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Deleting offline snapshot d298e695-483e-4273-b76c-dd69c124cd61 of volume 55479892-329c-4544-800d-1db84317f3f0 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] snapshot_file for this snap is: volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[04508c4e-ad30-4b8c-ae2c-8b28895723be]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:27 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 Jul 05 17:40:27 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:27 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235" returned: 0 in 0.807s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:27 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235 Jul 05 17:40:27 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:28 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61" returned: 0 in 0.903s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55479892-329c-4544-800d-1db84317f3f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:40:28 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-01f62906-8964-4b01-81b6-747cf1448235" returned: 0 in 0.777s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb41a7e-7d08-4ef5-9407-c74436cb36a9]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-01f62906-8964-4b01-81b6-747cf1448235" released by "delete_volume" :: held 1.710s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Created reservations ['cb7a6383-5df7-4826-9d2c-5fdc251f3a0c', '2160dc91-5430-4f57-af5c-9ee95840a040', '27e457e4-5380-4fe1-9b4c-37550f0c11b5', '8a599b9a-060c-4dd8-8db2-d2f644434bc6'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:28 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 Jul 05 17:40:28 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:28 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:28 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-fccc0b14-a6c6-4957-b085-4a5a7feff1bc-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-fccc0b14-a6c6-4957-b085-4a5a7feff1bc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "cinder-quobyte-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8546cc19-f6a0-44a2-82a4-f16873acc187]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:29 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc Jul 05 17:40:29 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:29 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0" returned: 0 in 0.957s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:29 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 Jul 05 17:40:29 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:29 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.949s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Deleted volume successfully. Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d42e231c-b4dd-4301-a810-7ec9b888db10 tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-01f62906-8964-4b01-81b6-747cf1448235-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Flow 'volume_create_manager' (bdda62cf-b550-4fea-8350-4bdc4996a39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b62fe2a-bc23-4a2b-88ee-b9caf69f8aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b62fe2a-bc23-4a2b-88ee-b9caf69f8aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8288414-f1a5-49bc-856a-699e96f9caea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582b32956fb94d88a9a89f5568644a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:30Z,use_quota=True,user_id='8ce4f3997a1b48dc879489b7285dc875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c7f8c0-40bf-4561-a23a-47ce435e05ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c7f8c0-40bf-4561-a23a-47ce435e05ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c94c4e-18c0-48c4-b6b0-e39933aef3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG cinder.image.glance [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Creating Keystone auth plugin from conf {{(pid=86459) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 17:40:29 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" returned: 0 in 1.041s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:30 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc Jul 05 17:40:30 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c94c4e-18c0-48c4-b6b0-e39933aef3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8288414-f1a5-49bc-856a-699e96f9caea', 'volume_name': 'volume-b8288414-f1a5-49bc-856a-699e96f9caea', 'volume_size': 1, 'image_id': 'ae1b3e64-d376-43da-ad78-ee49999de168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae1b3e64-d376-43da-ad78-ee49999de168', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1980e6119ee093aecf24f468a8c04d7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '582b32956fb94d88a9a89f5568644a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd2ee2f6458ae3d71a975c8283a72b2dc7d3668417a9f5043c52b1b02024c6c190e11af4162bad9f89e5218782961a80c81be0cd7ade6f37f169e4956a76b4a3', 'id': 'ae1b3e64-d376-43da-ad78-ee49999de168', 'created_at': datetime.datetime(2026, 7, 5, 15, 40, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 40, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae1b3e64-d376-43da-ad78-ee49999de168/file', 'properties': {}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28befb21-6bf6-45ba-9805-19a23e38d71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28befb21-6bf6-45ba-9805-19a23e38d71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4cb4c3-781c-474f-80c5-ac926124decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:30 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Volume b8288414-f1a5-49bc-856a-699e96f9caea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8288414-f1a5-49bc-856a-699e96f9caea', 'volume_size': 1, 'image_id': 'ae1b3e64-d376-43da-ad78-ee49999de168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae1b3e64-d376-43da-ad78-ee49999de168', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1980e6119ee093aecf24f468a8c04d7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '582b32956fb94d88a9a89f5568644a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd2ee2f6458ae3d71a975c8283a72b2dc7d3668417a9f5043c52b1b02024c6c190e11af4162bad9f89e5218782961a80c81be0cd7ade6f37f169e4956a76b4a3', 'id': 'ae1b3e64-d376-43da-ad78-ee49999de168', 'created_at': datetime.datetime(2026, 7, 5, 15, 40, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 40, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae1b3e64-d376-43da-ad78-ee49999de168/file', 'properties': {}}, 'image_service': } Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Trying to clone b8288414-f1a5-49bc-856a-699e96f9caea from image ae1b3e64-d376-43da-ad78-ee49999de168 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae1b3e64-d376-43da-ad78-ee49999de168', 'metadata': {}}]). {{(pid=86459) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 17:40:30 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61" returned: 0 in 0.953s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:30 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61 Jul 05 17:40:30 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 17:40:30 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Image download 0.00 MB at 0.00 MB/s Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e88208-aad4-4fba-88ff-319abe2556e8]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:30 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD Jul 05 17:40:30 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:30 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" returned: 0 in 0.832s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-quobyte-fccc0b14-a6c6-4957-b085-4a5a7feff1bc" released by "delete_volume" :: held 1.925s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:30 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0.d298e695-483e-4273-b76c-dd69c124cd61" returned: 0 in 0.729s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Created reservations ['15aa62d8-e2d3-45e6-8a13-c2ffa72a63ed', '696aa86e-3944-4ee7-98a2-6b50d56a4b7a', '7c7d07b7-0943-4d99-bc8a-df1306d918d2', 'a7621fc3-4f5c-4101-971b-47085a548e4c'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-quobyte-d298e695-483e-4273-b76c-dd69c124cd61" released by "_delete_snapshot" :: held 3.721s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-quobyte-55479892-329c-4544-800d-1db84317f3f0" released by "delete_snapshot" :: held 3.765s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Created reservations ['2b5aab55-2726-461d-b829-bd46aabfb713', 'fb298cac-19f8-4527-9524-478fe94fd21d', '5b6f7b96-18d7-4d3c-b320-d1a4112e76e0', 'bcd551e0-a41b-4bce-8880-5ac691d25d04'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:31 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:31 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Delete snapshot completed successfully. Jul 05 17:40:31 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD" returned: 0 in 0.893s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b9a12e4a-f458-436e-8db3-b1875b3c1ad2 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-d298e695-483e-4273-b76c-dd69c124cd61-delete_snapshot" released by "delete_snapshot" :: held 4.045s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:31 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD Jul 05 17:40:31 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "cinder-55479892-329c-4544-800d-1db84317f3f0-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-55479892-329c-4544-800d-1db84317f3f0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "cinder-quobyte-55479892-329c-4544-800d-1db84317f3f0" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-quobyte-55479892-329c-4544-800d-1db84317f3f0" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[77aeea56-fd84-4cad-b29a-55e7bfbdd10f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:31 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 Jul 05 17:40:31 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:32 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.074s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:32 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:32 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Deleted volume successfully. Jul 05 17:40:32 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-042a2340-5112-4329-8591-920cf1d6601e tempest-VolumeDependencyTests-1576368502 None] Lock "cinder-fccc0b14-a6c6-4957-b085-4a5a7feff1bc-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:32 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD" returned: 1 in 1.071s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:40:32 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Temporary image ae1b3e64-d376-43da-ad78-ee49999de168 is fetched for user 8ce4f3997a1b48dc879489b7285dc875. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 17:40:32 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a4112-c81f-4b9d-86ab-b29a17ddac47]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:32 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD Jul 05 17:40:32 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:33 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0" returned: 0 in 1.283s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:33 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0 Jul 05 17:40:33 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:33 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD" returned: 0 in 0.966s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:33 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD Jul 05 17:40:33 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:33 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-55479892-329c-4544-800d-1db84317f3f0" returned: 0 in 0.789s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-quobyte-55479892-329c-4544-800d-1db84317f3f0" released by "delete_volume" :: held 2.186s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Created reservations ['9ad89808-96e4-4549-a7fb-e4d49869278a', '4d635088-1ff8-4181-85d4-0d97821f9434', '39ac1f41-fae7-4c21-b427-031126dfbe07', '35a13421-5479-4eab-936e-39d96797bc24'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:33 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:33 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:34 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD" returned: 1 in 0.966s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8288414-f1a5-49bc-856a-699e96f9caea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582b32956fb94d88a9a89f5568644a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:30Z,use_quota=True,user_id='8ce4f3997a1b48dc879489b7285dc875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Creating volume b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:40:34 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:34 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea 1073741824 Jul 05 17:40:34 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:34 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.855s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Deleted volume successfully. Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-7e8797c4-f07e-46fc-ad35-6e69577030ed tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-55479892-329c-4544-800d-1db84317f3f0-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "cinder-06b9b025-a40a-4086-b90a-0ceb6135d76d-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-06b9b025-a40a-4086-b90a-0ceb6135d76d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "cinder-quobyte-06b9b025-a40a-4086-b90a-0ceb6135d76d" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-quobyte-06b9b025-a40a-4086-b90a-0ceb6135d76d" acquired by "delete_volume" :: waited 0.033s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4531a8-1164-495c-9143-390e538f8556]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:35 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d Jul 05 17:40:35 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:35 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea 1073741824" returned: 0 in 1.138s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:35 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea Jul 05 17:40:35 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-24c15cef-be48-40ca-aa1c-455df3766dc5 tempest-ProjectAdminTests-1873575777 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86459) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 17:40:36 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d" returned: 0 in 0.973s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:36 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d Jul 05 17:40:36 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:36 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea" returned: 0 in 0.699s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Attempting download of ae1b3e64-d376-43da-ad78-ee49999de168 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae1b3e64-d376-43da-ad78-ee49999de168', 'metadata': {}}])) to volume b8288414-f1a5-49bc-856a-699e96f9caea. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1669dde2-65e2-4be0-8173-e1f328271fca]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae1b3e64-d376-43da-ad78-ee49999de168_t4jecnzv {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:36 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae1b3e64-d376-43da-ad78-ee49999de168_t4jecnzv Jul 05 17:40:36 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:36 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-06b9b025-a40a-4086-b90a-0ceb6135d76d" returned: 0 in 0.744s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-quobyte-06b9b025-a40a-4086-b90a-0ceb6135d76d" released by "delete_volume" :: held 1.789s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:36 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Created reservations ['96528c31-2139-41aa-a543-5246b49c142b', 'dc53d069-e47e-47f1-8213-f12e2420b049', '7819c4f8-16d7-47c7-9233-9bcc1882ff69', '2657133d-50ba-4571-8e58-9ea4b5258aa6'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:37 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:37 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:37 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae1b3e64-d376-43da-ad78-ee49999de168_t4jecnzv" returned: 0 in 0.873s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae1b3e64-d376-43da-ad78-ee49999de168_t4jecnzv {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:37 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae1b3e64-d376-43da-ad78-ee49999de168_t4jecnzv Jul 05 17:40:37 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:38 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.020s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:38 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Deleted volume successfully. Jul 05 17:40:38 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae1b3e64-d376-43da-ad78-ee49999de168_t4jecnzv" returned: 1 in 0.984s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae1b3e64-d376-43da-ad78-ee49999de168_t4jecnzv' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:40:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-bcaacdee-a396-4938-adab-12eefb858bd8 tempest-CinderUnicodeTest-1192312622 None] Lock "cinder-06b9b025-a40a-4086-b90a-0ceb6135d76d-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aefa29a-fadc-4199-b8ca-ad4b0ce25c07]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:38 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD Jul 05 17:40:38 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:39 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD" returned: 0 in 0.959s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:39 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD Jul 05 17:40:39 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:39 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD" returned: 1 in 0.828s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:40:39 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] ae1b3e64-d376-43da-ad78-ee49999de168 was raw, converting to raw {{(pid=86459) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 17:40:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:39 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea Jul 05 17:40:39 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:40 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea" returned: 0 in 0.805s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:40 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae1b3e64-d376-43da-ad78-ee49999de168_wgi1y_48devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:40:40 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 17:40:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:40 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea 1G Jul 05 17:40:40 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:41 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea 1G" returned: 0 in 0.780s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ceb04-b3b7-4c7b-be90-668bcc9c2ce6]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:41 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea Jul 05 17:40:41 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:42 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea" returned: 0 in 0.868s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:42 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea Jul 05 17:40:42 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:43 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea" returned: 1 in 0.773s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Downloaded image ae1b3e64-d376-43da-ad78-ee49999de168 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae1b3e64-d376-43da-ad78-ee49999de168', 'metadata': {}}])) to volume b8288414-f1a5-49bc-856a-699e96f9caea successfully. {{(pid=86459) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Temporary image ae1b3e64-d376-43da-ad78-ee49999de168 for user 8ce4f3997a1b48dc879489b7285dc875 is deleted. {{(pid=86459) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.volume.volume_utils [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Marking volume b8288414-f1a5-49bc-856a-699e96f9caea as bootable. {{(pid=86459) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Copying metadata from image ae1b3e64-d376-43da-ad78-ee49999de168 to b8288414-f1a5-49bc-856a-699e96f9caea. {{(pid=86459) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Creating volume glance metadata for volume b8288414-f1a5-49bc-856a-699e96f9caea backed by image ae1b3e64-d376-43da-ad78-ee49999de168 with: {'image_id': 'ae1b3e64-d376-43da-ad78-ee49999de168', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1980e6119ee093aecf24f468a8c04d7b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86459) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4cb4c3-781c-474f-80c5-ac926124decb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8288414-f1a5-49bc-856a-699e96f9caea', 'volume_size': 1, 'image_id': 'ae1b3e64-d376-43da-ad78-ee49999de168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae1b3e64-d376-43da-ad78-ee49999de168', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1980e6119ee093aecf24f468a8c04d7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '582b32956fb94d88a9a89f5568644a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd2ee2f6458ae3d71a975c8283a72b2dc7d3668417a9f5043c52b1b02024c6c190e11af4162bad9f89e5218782961a80c81be0cd7ade6f37f169e4956a76b4a3', 'id': 'ae1b3e64-d376-43da-ad78-ee49999de168', 'created_at': datetime.datetime(2026, 7, 5, 15, 40, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 15, 40, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae1b3e64-d376-43da-ad78-ee49999de168/file', 'properties': {}}, 'image_service': }' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8049ec94-5be7-4aee-851c-2a78d0ad0a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:43 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Volume volume-b8288414-f1a5-49bc-856a-699e96f9caea (b8288414-f1a5-49bc-856a-699e96f9caea): created successfully Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8049ec94-5be7-4aee-851c-2a78d0ad0a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Flow 'volume_create_manager' (bdda62cf-b550-4fea-8350-4bdc4996a39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:43 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2d736fed-e9ea-438d-9c6d-43c116fa3324 tempest-VolumeImageDependencyTests-613494990 None] Created volume successfully. Jul 05 17:40:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Acquiring lock "cinder-b8288414-f1a5-49bc-856a-699e96f9caea-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Lock "cinder-b8288414-f1a5-49bc-856a-699e96f9caea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Acquiring lock "cinder-quobyte-b8288414-f1a5-49bc-856a-699e96f9caea" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:40:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Lock "cinder-quobyte-b8288414-f1a5-49bc-856a-699e96f9caea" acquired by "delete_volume" :: waited 0.022s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:40:44 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed9f56-cb4a-4b94-8a4e-48059c24199e]: (4, 'raw') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:44 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea Jul 05 17:40:44 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:45 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea" returned: 0 in 0.887s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:45 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea Jul 05 17:40:45 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:46 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea" returned: 1 in 0.887s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea' failed. Not Retrying. {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 17:40:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:46 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea Jul 05 17:40:46 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:47 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8288414-f1a5-49bc-856a-699e96f9caea" returned: 0 in 0.871s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Lock "cinder-quobyte-b8288414-f1a5-49bc-856a-699e96f9caea" released by "delete_volume" :: held 2.738s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Created reservations ['812f904d-5e90-41b9-b2fc-265da9829ab0', '191292de-4353-4dee-9b23-864ad4c83aae', 'bb558f19-f2b4-4fb3-9fe3-228cfbff0723', '913cd809-b51a-48c8-b10f-b70669f0c791'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:47 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:47 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:48 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.780s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:48 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Deleted volume successfully. Jul 05 17:40:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c06d7ea6-a49c-4084-a478-4ce882d0d0bb tempest-VolumeImageDependencyTests-613494990 None] Lock "cinder-b8288414-f1a5-49bc-856a-699e96f9caea-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (8b976e0a-6535-4ff5-ae67-0533b4f8bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79a204b-48ad-4ae9-b55f-492a38cd86a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79a204b-48ad-4ae9-b55f-492a38cd86a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-804824301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b20870-060c-48bf-90c8-d8381d60fa26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:51Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426ce5db-f9f4-41b2-b8f1-2eb4b1770b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426ce5db-f9f4-41b2-b8f1-2eb4b1770b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fe9789-36b8-4056-bbbc-3f8e924f73c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fe9789-36b8-4056-bbbc-3f8e924f73c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b20870-060c-48bf-90c8-d8381d60fa26', 'volume_name': 'volume-d9b20870-060c-48bf-90c8-d8381d60fa26', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d77553-8c80-4bbe-ae95-cc8f2394d525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d77553-8c80-4bbe-ae95-cc8f2394d525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29ef3bd-d5ef-46fb-8dc1-b72fb923323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:50 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Volume d9b20870-060c-48bf-90c8-d8381d60fa26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b20870-060c-48bf-90c8-d8381d60fa26', 'volume_size': 1} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-804824301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b20870-060c-48bf-90c8-d8381d60fa26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:51Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Creating volume d9b20870-060c-48bf-90c8-d8381d60fa26 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:40:50 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:50 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 1073741824 Jul 05 17:40:50 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:50 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:40:50 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (64ad75cc-4acf-426d-b372-97db14b2f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69a6c31-6918-4dd2-b7f5-62dd4368e1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69a6c31-6918-4dd2-b7f5-62dd4368e1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737103660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7817f3ff-44ed-4648-b6bb-be2d342c4042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:51Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2681cb-57e3-4f74-a0a5-2d3245287c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2681cb-57e3-4f74-a0a5-2d3245287c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa4b8ee-d2cc-40bd-8fff-a562632a61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa4b8ee-d2cc-40bd-8fff-a562632a61f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7817f3ff-44ed-4648-b6bb-be2d342c4042', 'volume_name': 'volume-7817f3ff-44ed-4648-b6bb-be2d342c4042', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8402879-dd23-4876-942d-36f9a88fd727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8402879-dd23-4876-942d-36f9a88fd727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df840fb5-dd0a-4dd0-b7eb-1ae801f36510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:51 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Volume 7817f3ff-44ed-4648-b6bb-be2d342c4042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7817f3ff-44ed-4648-b6bb-be2d342c4042', 'volume_size': 1} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:51 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 1073741824" returned: 0 in 1.004s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:51 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 Jul 05 17:40:51 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:51 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 1.043s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:40:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:40:52 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26" returned: 0 in 0.972s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.284s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737103660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7817f3ff-44ed-4648-b6bb-be2d342c4042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:40:51Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Creating volume 7817f3ff-44ed-4648-b6bb-be2d342c4042 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:40:52 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:52 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 1073741824 Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29ef3bd-d5ef-46fb-8dc1-b72fb923323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b20870-060c-48bf-90c8-d8381d60fa26', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:52 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8289c20-5fc9-4f5d-b4ab-d1376d82e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:52 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Volume volume-d9b20870-060c-48bf-90c8-d8381d60fa26 (d9b20870-060c-48bf-90c8-d8381d60fa26): created successfully Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8289c20-5fc9-4f5d-b4ab-d1376d82e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (8b976e0a-6535-4ff5-ae67-0533b4f8bedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:52 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-7c7525dd-47df-48ad-983c-1e8fcccae904 tempest-ProjectReaderTests-1032370073 None] Created volume successfully. Jul 05 17:40:53 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 1073741824" returned: 0 in 1.090s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:53 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 Jul 05 17:40:53 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:54 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042" returned: 0 in 0.848s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.580s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Creating offline snapshot 9a314e3b-7bda-4384-bc90-f9a8cee9f27e of volume d9b20870-060c-48bf-90c8-d8381d60fa26 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df840fb5-dd0a-4dd0-b7eb-1ae801f36510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7817f3ff-44ed-4648-b6bb-be2d342c4042', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547e75e8-f2c0-4bae-98cd-c3cae22ba6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[54833345-b059-489c-ab9f-a18c04c7fc48]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:54 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Volume volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 (7817f3ff-44ed-4648-b6bb-be2d342c4042): created successfully Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547e75e8-f2c0-4bae-98cd-c3cae22ba6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:40:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (64ad75cc-4acf-426d-b372-97db14b2f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:40:54 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-513d7ac2-9251-4f2e-8995-2ad789956935 tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:40:54 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 Jul 05 17:40:54 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:55 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26" returned: 0 in 1.062s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:55 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e 1G Jul 05 17:40:55 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:40:56 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e 1G" returned: 0 in 1.052s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b20870-060c-48bf-90c8-d8381d60fa26 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:56 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b20870-060c-48bf-90c8-d8381d60fa26 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e Jul 05 17:40:56 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:57 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b20870-060c-48bf-90c8-d8381d60fa26 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e" returned: 0 in 0.779s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:57 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e is being set with open permissions: ugo+rw Jul 05 17:40:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:57 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e Jul 05 17:40:57 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:58 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e" returned: 0 in 0.730s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:58 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.info Jul 05 17:40:58 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:59 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.info" returned: 0 in 0.760s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:59 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.info is being set with open permissions: ugo+rw Jul 05 17:40:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:40:59 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.info Jul 05 17:40:59 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:40:59 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 05 17:40:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.info" returned: 0 in 0.709s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:40:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.206s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:40:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.633s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:40:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Creating offline snapshot f4c70e40-840a-4cb8-b594-77c1d57e1fc2 of volume 7817f3ff-44ed-4648-b6bb-be2d342c4042 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d032b2-1701-4da0-8feb-25bf9e0ab806]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4a113d96-73b5-49e8-b3c6-37731307d1db tempest-ProjectReaderTests-1032370073 None] Create snapshot completed successfully Jul 05 17:41:00 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 Jul 05 17:41:00 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-9a314e3b-7bda-4384-bc90-f9a8cee9f27e-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Lock "cinder-9a314e3b-7bda-4384-bc90-f9a8cee9f27e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-d9b20870-060c-48bf-90c8-d8381d60fa26" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-d9b20870-060c-48bf-90c8-d8381d60fa26" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-9a314e3b-7bda-4384-bc90-f9a8cee9f27e" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-9a314e3b-7bda-4384-bc90-f9a8cee9f27e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Deleting offline snapshot 9a314e3b-7bda-4384-bc90-f9a8cee9f27e of volume d9b20870-060c-48bf-90c8-d8381d60fa26 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] snapshot_file for this snap is: volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f40646-a3a0-41a5-8a8e-93a606ad4d9d]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:00 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042" returned: 0 in 0.947s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:01 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 1G Jul 05 17:41:01 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:01 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e Jul 05 17:41:01 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:01 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e" returned: 0 in 0.856s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9b20870-060c-48bf-90c8-d8381d60fa26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:41:01 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 1G" returned: 0 in 0.878s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[182ae0b0-b227-45a0-aa2e-14cb12936515]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:01 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 Jul 05 17:41:01 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:01 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 Jul 05 17:41:01 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:02 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2" returned: 0 in 0.811s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:02 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 is being set with open permissions: ugo+rw Jul 05 17:41:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:02 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 Jul 05 17:41:02 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:02 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26" returned: 0 in 0.906s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:02 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e Jul 05 17:41:02 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:03 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2" returned: 0 in 0.664s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:03 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.info Jul 05 17:41:03 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:03 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e" returned: 0 in 0.862s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:03 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e Jul 05 17:41:03 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:04 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.info" returned: 0 in 0.694s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:04 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.info is being set with open permissions: ugo+rw Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:04 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.info Jul 05 17:41:04 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:04 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26.9a314e3b-7bda-4384-bc90-f9a8cee9f27e" returned: 0 in 0.732s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-9a314e3b-7bda-4384-bc90-f9a8cee9f27e" released by "_delete_snapshot" :: held 3.480s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-d9b20870-060c-48bf-90c8-d8381d60fa26" released by "delete_snapshot" :: held 3.508s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Created reservations ['feb3878b-ab48-44f0-a4df-76f6f62b2503', '0ac46fec-213c-4cab-a54e-577c9221a5f5', '90c53794-cd8d-4ae8-beb4-719ef4b3eb24', 'df9d80c0-c99e-4aeb-9e04-01b424304cef'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Delete snapshot completed successfully. Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-730ec513-318f-41a3-84a2-7349a41e2b6a tempest-ProjectReaderTests-1032370073 None] Lock "cinder-9a314e3b-7bda-4384-bc90-f9a8cee9f27e-delete_snapshot" released by "delete_snapshot" :: held 3.667s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:04 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.info" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.880s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f30b44f0-3b82-4399-99ee-0df715641a34 tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-d9b20870-060c-48bf-90c8-d8381d60fa26-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-d9b20870-060c-48bf-90c8-d8381d60fa26-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-d9b20870-060c-48bf-90c8-d8381d60fa26" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-d9b20870-060c-48bf-90c8-d8381d60fa26" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d347795-8e6c-4366-9db3-1f9d5a8419e1]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:05 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 Jul 05 17:41:05 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-f4c70e40-840a-4cb8-b594-77c1d57e1fc2-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Lock "cinder-f4c70e40-840a-4cb8-b594-77c1d57e1fc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-7817f3ff-44ed-4648-b6bb-be2d342c4042" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-7817f3ff-44ed-4648-b6bb-be2d342c4042" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-f4c70e40-840a-4cb8-b594-77c1d57e1fc2" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-f4c70e40-840a-4cb8-b594-77c1d57e1fc2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot f4c70e40-840a-4cb8-b594-77c1d57e1fc2 of volume 7817f3ff-44ed-4648-b6bb-be2d342c4042 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c46f45-9a6b-4541-9a9c-471e8c3c6700]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:05 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 Jul 05 17:41:05 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:06 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26" returned: 0 in 0.860s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:06 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26 Jul 05 17:41:06 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:06 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2" returned: 0 in 0.905s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7817f3ff-44ed-4648-b6bb-be2d342c4042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad50cbc9-23eb-4295-a4f2-61dc5a6d4f68]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:06 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-d9b20870-060c-48bf-90c8-d8381d60fa26" returned: 0 in 0.699s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-d9b20870-060c-48bf-90c8-d8381d60fa26" released by "delete_volume" :: held 1.627s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Created reservations ['19f2ece8-6b58-43c5-b975-06b1ed23c841', '044c95d8-3544-48d5-97f0-c9d93c9d838f', '19c832c4-c5fb-4e2e-9094-d03b3a21a38a', 'fda6d1fb-7b9d-496a-b5b5-958ecb5225a9'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:06 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 Jul 05 17:41:06 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:06 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:41:06 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:07 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042" returned: 0 in 0.952s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:07 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 Jul 05 17:41:07 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:07 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.857s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:41:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Deleted volume successfully. Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d3c89272-8209-4b43-8249-995fb0d4aeb9 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-d9b20870-060c-48bf-90c8-d8381d60fa26-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (b02e748f-303a-46dd-943a-ac21a84596cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d8c74c-c9e8-499c-a483-133b022c4239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d8c74c-c9e8-499c-a483-133b022c4239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1596683801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b534ba-c9a0-4996-941c-02d808b01516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:08Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1813331d-0d84-4e96-a3b3-4c3ebec74529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1813331d-0d84-4e96-a3b3-4c3ebec74529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490c7577-440e-42d5-8a0f-f089b30ccd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490c7577-440e-42d5-8a0f-f089b30ccd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b534ba-c9a0-4996-941c-02d808b01516', 'volume_name': 'volume-32b534ba-c9a0-4996-941c-02d808b01516', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2066acc4-4a10-4560-abae-50556b99790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2066acc4-4a10-4560-abae-50556b99790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd3524f-225e-4e97-aeaf-88a817da7c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:07 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Volume 32b534ba-c9a0-4996-941c-02d808b01516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b534ba-c9a0-4996-941c-02d808b01516', 'volume_size': 1} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1596683801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b534ba-c9a0-4996-941c-02d808b01516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:08Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Creating volume 32b534ba-c9a0-4996-941c-02d808b01516 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:41:07 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:41:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:08 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 1073741824 Jul 05 17:41:08 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:08 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2" returned: 0 in 1.073s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:08 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2 Jul 05 17:41:08 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:09 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 1073741824" returned: 0 in 1.143s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:09 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 Jul 05 17:41:09 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:09 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042.f4c70e40-840a-4cb8-b594-77c1d57e1fc2" returned: 0 in 0.785s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-f4c70e40-840a-4cb8-b594-77c1d57e1fc2" released by "_delete_snapshot" :: held 3.877s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-7817f3ff-44ed-4648-b6bb-be2d342c4042" released by "delete_snapshot" :: held 3.902s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:09 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Created reservations ['766574d5-ab75-418e-928b-2971a09e4645', '80380c71-88c7-4e35-a291-2d113e3a8cd3', 'fbc13d0c-1e62-411b-b26b-216ffd13a6f5', '9548ec6a-b401-4546-afa3-42aaeefc7e59'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:09 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:41:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-977f2b93-09e6-4424-a37d-87cbf88924f2 tempest-ProjectMemberTests-514811562 None] Lock "cinder-f4c70e40-840a-4cb8-b594-77c1d57e1fc2-delete_snapshot" released by "delete_snapshot" :: held 4.071s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:10 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516" returned: 0 in 0.825s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd3524f-225e-4e97-aeaf-88a817da7c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b534ba-c9a0-4996-941c-02d808b01516', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302e2a91-ba65-4b9e-8831-5edf45486733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-7817f3ff-44ed-4648-b6bb-be2d342c4042-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:10 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Volume volume-32b534ba-c9a0-4996-941c-02d808b01516 (32b534ba-c9a0-4996-941c-02d808b01516): created successfully Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302e2a91-ba65-4b9e-8831-5edf45486733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (b02e748f-303a-46dd-943a-ac21a84596cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Lock "cinder-7817f3ff-44ed-4648-b6bb-be2d342c4042-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-61b67e44-9fca-4956-be64-0aa201425e2b tempest-ProjectReaderTests-1032370073 None] Created volume successfully. Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-7817f3ff-44ed-4648-b6bb-be2d342c4042" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-7817f3ff-44ed-4648-b6bb-be2d342c4042" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b102c1-8ed4-4eda-bc34-b3b79088c536]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:10 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 Jul 05 17:41:10 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:11 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042" returned: 0 in 0.841s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:11 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042 Jul 05 17:41:11 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Creating offline snapshot 31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 of volume 32b534ba-c9a0-4996-941c-02d808b01516 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d68a9-4741-44ac-9cda-9e52438098e0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:11 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 Jul 05 17:41:11 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:11 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7817f3ff-44ed-4648-b6bb-be2d342c4042" returned: 0 in 0.850s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-7817f3ff-44ed-4648-b6bb-be2d342c4042" released by "delete_volume" :: held 1.769s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Created reservations ['d4e7d7aa-1c2e-40b2-9fba-ddba5214ebc5', '655629e0-b9d6-4c9a-905b-f25bc3c8d296', 'd6af6e7d-a54d-4105-8b7f-5d5c9d13fbb0', '8b4ca2f4-61f8-4d10-9012-4c0b80b57f12'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:12 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:41:12 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:12 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516" returned: 0 in 0.833s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:12 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 1G Jul 05 17:41:12 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (d83b423a-39ba-471c-b73b-adc76ef92fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda14f62-fad7-4d36-b0f0-7af53226b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda14f62-fad7-4d36-b0f0-7af53226b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1266176846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a865e603-73d1-44bf-8a05-dc1e11b7ed31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:13Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:13 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a9bdc6-753f-46b8-b4cb-2263d21fc534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a9bdc6-753f-46b8-b4cb-2263d21fc534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c6a25d-50bb-46ef-a5a6-1c2c4cf2abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c6a25d-50bb-46ef-a5a6-1c2c4cf2abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a865e603-73d1-44bf-8a05-dc1e11b7ed31', 'volume_name': 'volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1a05f7-6128-4f17-bdeb-92f886d8b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1a05f7-6128-4f17-bdeb-92f886d8b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9596ad5-795b-43f7-8c72-36cc10f2b7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:13 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Volume a865e603-73d1-44bf-8a05-dc1e11b7ed31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31', 'volume_size': 1} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.970s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:41:13 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-71cbd0f7-3acd-49a7-b9e3-ee20cf772eb1 tempest-ProjectMemberTests-514811562 None] Lock "cinder-7817f3ff-44ed-4648-b6bb-be2d342c4042-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:13 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 1G" returned: 0 in 1.029s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b534ba-c9a0-4996-941c-02d808b01516 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:13 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b534ba-c9a0-4996-941c-02d808b01516 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 Jul 05 17:41:13 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:14 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b534ba-c9a0-4996-941c-02d808b01516 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1" returned: 0 in 0.769s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:14 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 is being set with open permissions: ugo+rw Jul 05 17:41:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:14 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 Jul 05 17:41:14 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:14 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1" returned: 0 in 0.672s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:14 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.info Jul 05 17:41:14 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:15 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.info" returned: 0 in 0.784s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:15 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.info is being set with open permissions: ugo+rw Jul 05 17:41:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:15 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.info Jul 05 17:41:15 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:16 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.info" returned: 0 in 0.636s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.823s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.200s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1266176846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a865e603-73d1-44bf-8a05-dc1e11b7ed31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:13Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Creating volume a865e603-73d1-44bf-8a05-dc1e11b7ed31 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:41:16 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:41:16 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 1073741824 Jul 05 17:41:16 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Flow 'volume_create_manager' (9dbfc76f-8ae9-46e4-8663-9ed2f0f2814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00c6b92-bc5a-4f6d-8bfc-a43b9868b93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00c6b92-bc5a-4f6d-8bfc-a43b9868b93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-562428940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e3b236ab9c4530afa9622a47defd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:16Z,use_quota=True,user_id='efc14189d6af45e1932ace4989971d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa114095-5634-4870-8549-6609132a74b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa114095-5634-4870-8549-6609132a74b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c2e925-395f-4b88-9d69-f498723de0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c2e925-395f-4b88-9d69-f498723de0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a', 'volume_name': 'volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733bf31f-5c2f-47b9-ad6f-cb8930161f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733bf31f-5c2f-47b9-ad6f-cb8930161f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e409a5b4-0727-4a33-978d-a6f04ba04549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:16 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Volume e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a', 'volume_size': 1} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-1e79db25-66dd-43cf-847b-c8062edc9895 tempest-ProjectReaderTests-1032370073 None] Create snapshot completed successfully Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-31e36d48-ef29-43fd-ba1f-0a235f8b5ae1-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-31e36d48-ef29-43fd-ba1f-0a235f8b5ae1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-32b534ba-c9a0-4996-941c-02d808b01516" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-32b534ba-c9a0-4996-941c-02d808b01516" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-31e36d48-ef29-43fd-ba1f-0a235f8b5ae1" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-31e36d48-ef29-43fd-ba1f-0a235f8b5ae1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Deleting offline snapshot 31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 of volume 32b534ba-c9a0-4996-941c-02d808b01516 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] snapshot_file for this snap is: volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c7ba3e-28d8-4c28-8c4f-5d2a28ed9dfe]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:16 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 Jul 05 17:41:16 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:17 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 1073741824" returned: 0 in 0.823s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:17 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 Jul 05 17:41:17 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:17 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1" returned: 0 in 0.749s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b534ba-c9a0-4996-941c-02d808b01516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[daded9ff-5315-4467-b33f-a499fd6abeca]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:17 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 Jul 05 17:41:17 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:17 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31" returned: 0 in 0.636s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-562428940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e3b236ab9c4530afa9622a47defd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:16Z,use_quota=True,user_id='efc14189d6af45e1932ace4989971d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Creating volume e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:41:17 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:17 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a 1073741824 Jul 05 17:41:17 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9596ad5-795b-43f7-8c72-36cc10f2b7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b45ac6-cc26-4e91-9f8a-87d41c6fd4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:17 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Volume volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 (a865e603-73d1-44bf-8a05-dc1e11b7ed31): created successfully Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b45ac6-cc26-4e91-9f8a-87d41c6fd4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:17 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (d83b423a-39ba-471c-b73b-adc76ef92fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6616a693-c62a-42d2-8097-3b1f106bc4a6 tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:41:18 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516" returned: 0 in 0.776s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:18 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 Jul 05 17:41:18 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:18 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a 1073741824" returned: 0 in 0.896s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:18 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a Jul 05 17:41:18 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:19 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1" returned: 0 in 0.758s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:19 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1 Jul 05 17:41:19 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:19 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" returned: 0 in 0.690s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.931s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e409a5b4-0727-4a33-978d-a6f04ba04549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa81550-5958-4900-ac4e-449748102276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Creating offline snapshot d88f253b-f40b-43d7-abe9-06a36795dcbd of volume a865e603-73d1-44bf-8a05-dc1e11b7ed31 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:41:19 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Volume volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a (e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a): created successfully Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa81550-5958-4900-ac4e-449748102276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Flow 'volume_create_manager' (9dbfc76f-8ae9-46e4-8663-9ed2f0f2814c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34405ce-2d7d-4941-b3c3-fad189800a75]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-1776d1b2-e0fb-4192-b75b-d9c70e9fbccc tempest-SnapshotDependencyTests-1317698780 None] Created volume successfully. Jul 05 17:41:19 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 Jul 05 17:41:19 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:19 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516.31e36d48-ef29-43fd-ba1f-0a235f8b5ae1" returned: 0 in 0.645s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-31e36d48-ef29-43fd-ba1f-0a235f8b5ae1" released by "_delete_snapshot" :: held 3.020s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-32b534ba-c9a0-4996-941c-02d808b01516" released by "delete_snapshot" :: held 3.041s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Created reservations ['2aa9e2e4-cc5f-4dc1-9486-bad808a008af', 'd7f88e90-b869-4519-a36e-35bb39cbcc6f', 'd6ab7741-655f-4560-9974-e8d2f7c1d02b', '76c48769-25e5-411e-8bd0-8968ca7c6201'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:19 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Delete snapshot completed successfully. Jul 05 17:41:19 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-123af96a-cdf7-489b-8420-1b302fcedaf6 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-31e36d48-ef29-43fd-ba1f-0a235f8b5ae1-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:20 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31" returned: 0 in 0.778s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:20 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd 1G Jul 05 17:41:20 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-32b534ba-c9a0-4996-941c-02d808b01516-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Lock "cinder-32b534ba-c9a0-4996-941c-02d808b01516-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-32b534ba-c9a0-4996-941c-02d808b01516" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-32b534ba-c9a0-4996-941c-02d808b01516" acquired by "delete_volume" :: waited 0.013s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e516743-638a-434a-ae92-7942817d2159]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:21 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 Jul 05 17:41:21 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:21 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd 1G" returned: 0 in 0.859s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:21 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd Jul 05 17:41:21 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:21 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516" returned: 0 in 0.812s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:21 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516 Jul 05 17:41:21 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:21 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd" returned: 0 in 0.692s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:21 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd is being set with open permissions: ugo+rw Jul 05 17:41:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:21 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd Jul 05 17:41:21 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:22 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-32b534ba-c9a0-4996-941c-02d808b01516" returned: 0 in 0.655s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-32b534ba-c9a0-4996-941c-02d808b01516" released by "delete_volume" :: held 1.525s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:DELETE=8,cinder:SELECT=99,cinder:UPDATE=119,cinder:INSERT=29 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:41:22 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd" returned: 0 in 0.643s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:22 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.info Jul 05 17:41:22 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Created reservations ['9de05ce9-9255-4d4c-8e3d-fc5da3637eb4', 'd3f0c973-e82e-479e-9438-f92147ae1e33', '7f39d5ab-9baf-4849-9a57-bfb9b74b55c1', 'a4223ee4-0880-4aef-80d4-111dc6fcc540'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:22 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:41:22 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:23 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.info" returned: 0 in 0.636s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:23 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.info is being set with open permissions: ugo+rw Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:23 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.info Jul 05 17:41:23 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:23 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.697s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:41:23 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Deleted volume successfully. Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-eb312fb8-c783-4937-b340-94ee3495a8fb tempest-ProjectReaderTests-1032370073 None] Lock "cinder-32b534ba-c9a0-4996-941c-02d808b01516-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (b36ceb63-de5d-4d3b-a73e-b35f016804ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cfa94c-df46-462b-8956-5e62fa20cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cfa94c-df46-462b-8956-5e62fa20cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686480898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fdd728-1251-46f6-948e-4cd424462f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:24Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d44bb-9ce5-47d6-9250-7915bacd959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d44bb-9ce5-47d6-9250-7915bacd959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25523f94-6a99-4bf5-bd7a-938b31210552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25523f94-6a99-4bf5-bd7a-938b31210552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43fdd728-1251-46f6-948e-4cd424462f34', 'volume_name': 'volume-43fdd728-1251-46f6-948e-4cd424462f34', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d7ac84-f4b6-4dbd-ab51-28e9fc7637e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d7ac84-f4b6-4dbd-ab51-28e9fc7637e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1472f8-77ca-49b0-b15a-1676c4c22ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:23 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Volume 43fdd728-1251-46f6-948e-4cd424462f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43fdd728-1251-46f6-948e-4cd424462f34', 'volume_size': 1} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:23 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.info" returned: 0 in 0.646s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.376s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.101s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Creating offline snapshot 6b0fde06-2926-4061-be44-6307ad47c9dd of volume e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:41:23 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a4c1aeea-d165-41e1-b8fb-47d58f02fcf4 tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e07840c-5779-4be5-9fa3-1d867aff19de]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:23 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a Jul 05 17:41:23 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:24 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" returned: 0 in 0.759s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:24 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd 1G Jul 05 17:41:24 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-d88f253b-f40b-43d7-abe9-06a36795dcbd-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Lock "cinder-d88f253b-f40b-43d7-abe9-06a36795dcbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-a865e603-73d1-44bf-8a05-dc1e11b7ed31" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-a865e603-73d1-44bf-8a05-dc1e11b7ed31" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-d88f253b-f40b-43d7-abe9-06a36795dcbd" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-d88f253b-f40b-43d7-abe9-06a36795dcbd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot d88f253b-f40b-43d7-abe9-06a36795dcbd of volume a865e603-73d1-44bf-8a05-dc1e11b7ed31 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4718446-a836-4818-94cb-cab66243245e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:24 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd Jul 05 17:41:24 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:25 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd 1G" returned: 0 in 0.897s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:25 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd Jul 05 17:41:25 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:25 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd" returned: 0 in 0.828s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:41:25 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a2a6a3-cf6c-48da-9e37-947a1413c1ee]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:25 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 Jul 05 17:41:25 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:26 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd" returned: 0 in 0.668s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:26 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd is being set with open permissions: ugo+rw Jul 05 17:41:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:26 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd Jul 05 17:41:26 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:26 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31" returned: 0 in 0.751s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:26 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd Jul 05 17:41:26 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:26 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd" returned: 0 in 0.611s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:26 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=95,cinder:INSERT=41,cinder:UPDATE=109,cinder:DELETE=11 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:41:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:26 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.info Jul 05 17:41:26 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:27 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd" returned: 0 in 0.706s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:27 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd Jul 05 17:41:27 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:27 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.info" returned: 0 in 0.639s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:27 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.info is being set with open permissions: ugo+rw Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:27 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.info Jul 05 17:41:27 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:27 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31.d88f253b-f40b-43d7-abe9-06a36795dcbd" returned: 0 in 0.623s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-d88f253b-f40b-43d7-abe9-06a36795dcbd" released by "_delete_snapshot" :: held 3.018s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-a865e603-73d1-44bf-8a05-dc1e11b7ed31" released by "delete_snapshot" :: held 3.038s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Created reservations ['1bbefb54-5e90-4b5f-acf6-4b8d414bfdaf', '0258e218-8882-4baf-a1f4-27fafea6af10', 'fb651019-27a5-4571-895a-cb8aca44049d', '81c3cf2f-a49a-4587-a048-fb802ae34863'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:27 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:41:27 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-2b79c513-da46-442d-934a-ce25e10abb12 tempest-ProjectMemberTests-514811562 None] Lock "cinder-d88f253b-f40b-43d7-abe9-06a36795dcbd-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:28 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.info" returned: 0 in 0.608s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.285s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.424s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686480898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fdd728-1251-46f6-948e-4cd424462f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:24Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Creating volume 43fdd728-1251-46f6-948e-4cd424462f34 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:41:28 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:28 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34 1073741824 Jul 05 17:41:28 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:28 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b44f2662-3ed4-46f5-b876-edb92c4c6162 tempest-SnapshotDependencyTests-1317698780 None] Create snapshot completed successfully Jul 05 17:41:28 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34 1073741824" returned: 0 in 0.773s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:28 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34 Jul 05 17:41:28 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-a865e603-73d1-44bf-8a05-dc1e11b7ed31-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Lock "cinder-a865e603-73d1-44bf-8a05-dc1e11b7ed31-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-a865e603-73d1-44bf-8a05-dc1e11b7ed31" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-a865e603-73d1-44bf-8a05-dc1e11b7ed31" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf4941-9363-4418-b5d9-0c7cd2b50044]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:29 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 Jul 05 17:41:29 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:29 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34" returned: 0 in 0.705s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1472f8-77ca-49b0-b15a-1676c4c22ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43fdd728-1251-46f6-948e-4cd424462f34', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096bf50f-0fe4-4b5f-a714-76d1bdd03ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:29 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Volume volume-43fdd728-1251-46f6-948e-4cd424462f34 (43fdd728-1251-46f6-948e-4cd424462f34): created successfully Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096bf50f-0fe4-4b5f-a714-76d1bdd03ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (b36ceb63-de5d-4d3b-a73e-b35f016804ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:41:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-aff61c54-6988-4880-adbd-eba780c799a8 tempest-ProjectReaderTests-1032370073 None] Created volume successfully. Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Flow 'volume_create_manager' (6f253eba-4cd6-4395-83df-61f6794f6cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041cd51a-5a34-4b49-956b-132c0b19bb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041cd51a-5a34-4b49-956b-132c0b19bb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fcc003-8be9-4758-85ff-7d6baff53049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e3b236ab9c4530afa9622a47defd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b0fde06-2926-4061-be44-6307ad47c9dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:30Z,use_quota=True,user_id='efc14189d6af45e1932ace4989971d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60959abe-9578-4b9f-be26-7291e87bba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60959abe-9578-4b9f-be26-7291e87bba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6ff43e-a874-470b-a650-28986c577acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6ff43e-a874-470b-a650-28986c577acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '93fcc003-8be9-4758-85ff-7d6baff53049', 'volume_name': 'volume-93fcc003-8be9-4758-85ff-7d6baff53049', 'volume_size': 1, 'snapshot_id': '6b0fde06-2926-4061-be44-6307ad47c9dd'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca438ff-821e-4be8-aeb3-71609e7df0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca438ff-821e-4be8-aeb3-71609e7df0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513d698e-2d7f-4240-9c81-356d0cf1f780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:29 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Volume 93fcc003-8be9-4758-85ff-7d6baff53049: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-93fcc003-8be9-4758-85ff-7d6baff53049', 'volume_size': 1, 'snapshot_id': '6b0fde06-2926-4061-be44-6307ad47c9dd'} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-quobyte-6b0fde06-2926-4061-be44-6307ad47c9dd-93fcc003-8be9-4758-85ff-7d6baff53049" by "_create_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-6b0fde06-2926-4061-be44-6307ad47c9dd-93fcc003-8be9-4758-85ff-7d6baff53049" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Creating volume 93fcc003-8be9-4758-85ff-7d6baff53049 from snapshot 6b0fde06-2926-4061-be44-6307ad47c9dd {{(pid=86459) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-quobyte-93fcc003-8be9-4758-85ff-7d6baff53049" by "_copy_volume_from_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-93fcc003-8be9-4758-85ff-7d6baff53049" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] snapshot: 6b0fde06-2926-4061-be44-6307ad47c9dd, volume: 93fcc003-8be9-4758-85ff-7d6baff53049, {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d687bb1-fcfe-426e-a1f7-319e65523eb0]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:30 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd Jul 05 17:41:30 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:30 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31" returned: 0 in 0.865s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:30 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31 Jul 05 17:41:30 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:30 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a865e603-73d1-44bf-8a05-dc1e11b7ed31" returned: 0 in 0.620s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:30 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd" returned: 0 in 0.822s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Creating direct copy from snapshot {{(pid=86459) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-a865e603-73d1-44bf-8a05-dc1e11b7ed31" released by "delete_volume" :: held 1.558s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b34547-6125-4f7c-acb6-0ca28fa72b63]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Created reservations ['330de2be-d113-4ed9-a05c-4ebc5bb30a01', '799fa86e-0fb9-4105-9db1-3207d79fddc6', 'd1ce616a-134d-4908-a8b8-e30788967698', 'afe82ca6-af7d-474e-8199-1ed87e77edd2'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:30 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a Jul 05 17:41:30 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:30 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:41:30 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:31 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" returned: 0 in 0.803s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:31 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.utils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Path /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 not found in is_blk_device check {{(pid=86459) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.683s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:41:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:41:31 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 Jul 05 17:41:31 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-64e67965-bab5-4e92-bca3-0db8450daf7a tempest-ProjectMemberTests-514811562 None] Lock "cinder-a865e603-73d1-44bf-8a05-dc1e11b7ed31-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (b4372eeb-5d0e-484c-b4b9-5d5a176f35b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5b6bf4-3f07-4f0e-99dd-c49f781cb221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5b6bf4-3f07-4f0e-99dd-c49f781cb221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860718063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082519bc-bb0a-4431-8dc9-2cc76137e5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:32Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234ecdb7-9db6-4e6c-a352-53cb06bcdb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234ecdb7-9db6-4e6c-a352-53cb06bcdb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b1d1e6-8d7e-4286-838f-eaab68073c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b1d1e6-8d7e-4286-838f-eaab68073c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082519bc-bb0a-4431-8dc9-2cc76137e5f1', 'volume_name': 'volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcb000a-ade4-477c-b33c-d5ef6a3ea493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcb000a-ade4-477c-b33c-d5ef6a3ea493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d03e813-b7c6-4ee7-bfeb-832f597db512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:31 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Volume 082519bc-bb0a-4431-8dc9-2cc76137e5f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1', 'volume_size': 1} Jul 05 17:41:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:36 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049" returned: 0 in 4.500s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:36 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb43a00c-d870-45a2-8b0a-768fa0e8d5ae]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:36 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a Jul 05 17:41:36 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:36 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" returned: 0 in 0.928s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:36 devstack cinder-volume[86459]: DEBUG cinder.image.image_utils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Image conversion details: src /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 {{(pid=86459) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 17:41:36 devstack cinder-volume[86459]: INFO cinder.image.image_utils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Converted 1024.00 MB image at 227.51 MB/s Jul 05 17:41:36 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 is being set with open permissions: ugo+rw Jul 05 17:41:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:37 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 Jul 05 17:41:37 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:37 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049" returned: 0 in 0.695s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-93fcc003-8be9-4758-85ff-7d6baff53049" released by "_copy_volume_from_snapshot" :: held 7.850s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-6b0fde06-2926-4061-be44-6307ad47c9dd-93fcc003-8be9-4758-85ff-7d6baff53049" released by "_create_volume_from_snapshot" :: held 7.884s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.902s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.591s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Creating offline snapshot b41b3578-dc47-4301-a3a2-722e8cdfcf9f of volume 43fdd728-1251-46f6-948e-4cd424462f34 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ed08d-1f9b-4d05-9241-13f4c29eba60]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513d698e-2d7f-4240-9c81-356d0cf1f780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93fcc003-8be9-4758-85ff-7d6baff53049', 'volume_size': 1, 'snapshot_id': '6b0fde06-2926-4061-be44-6307ad47c9dd'}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b557ee64-27c6-4f63-81e2-19efaac2fa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:37 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Volume volume-93fcc003-8be9-4758-85ff-7d6baff53049 (93fcc003-8be9-4758-85ff-7d6baff53049): created successfully Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b557ee64-27c6-4f63-81e2-19efaac2fa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:37 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Flow 'volume_create_manager' (6f253eba-4cd6-4395-83df-61f6794f6cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4836b3d5-103a-4b7e-bf97-de7b1c033700 tempest-SnapshotDependencyTests-1317698780 None] Created volume successfully. Jul 05 17:41:37 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34 Jul 05 17:41:37 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-6b0fde06-2926-4061-be44-6307ad47c9dd-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-6b0fde06-2926-4061-be44-6307ad47c9dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-quobyte-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-quobyte-6b0fde06-2926-4061-be44-6307ad47c9dd" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-6b0fde06-2926-4061-be44-6307ad47c9dd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Deleting offline snapshot 6b0fde06-2926-4061-be44-6307ad47c9dd of volume e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] snapshot_file for this snap is: volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3856074-dc0a-4546-a501-7f16aad25210]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:38 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34" returned: 0 in 0.860s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:38 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f 1G Jul 05 17:41:38 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:38 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd Jul 05 17:41:38 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:39 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd" returned: 0 in 0.802s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:41:39 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50f399b-acb9-4683-b96f-4c7c6dfcd785]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:39 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f 1G" returned: 0 in 0.870s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fdd728-1251-46f6-948e-4cd424462f34 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:39 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a Jul 05 17:41:39 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:39 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fdd728-1251-46f6-948e-4cd424462f34 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f Jul 05 17:41:39 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:40 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:40 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fdd728-1251-46f6-948e-4cd424462f34 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f" returned: 0 in 0.677s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:40 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f is being set with open permissions: ugo+rw Jul 05 17:41:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:40 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd Jul 05 17:41:40 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:40 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f Jul 05 17:41:40 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:40 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.b41b3578-dc47-4301-a3a2-722e8cdfcf9f" returned: 0 in 0.630s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:40 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.info Jul 05 17:41:40 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:40 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd" returned: 0 in 0.707s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:40 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd Jul 05 17:41:40 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:41 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a.6b0fde06-2926-4061-be44-6307ad47c9dd" returned: 0 in 0.607s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:41 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.info" returned: 0 in 0.676s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:41 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.info is being set with open permissions: ugo+rw Jul 05 17:41:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-6b0fde06-2926-4061-be44-6307ad47c9dd" released by "_delete_snapshot" :: held 3.022s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" released by "delete_snapshot" :: held 3.050s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:41 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.info Jul 05 17:41:41 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:41 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Created reservations ['964861f0-bdce-4cb1-a81e-cb4fe9a7ed73', 'da9a378d-2261-411d-a3b1-f05f9f6e7706', '6bdf1856-a084-4e57-bf04-985c5e3c9673', '1942086b-5086-4556-81fb-fff81994a757'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Delete snapshot completed successfully. Jul 05 17:41:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-e2ca069b-d40a-42e6-b42f-373b5be537ab tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-6b0fde06-2926-4061-be44-6307ad47c9dd-delete_snapshot" released by "delete_snapshot" :: held 3.230s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:42 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-43fdd728-1251-46f6-948e-4cd424462f34.info" returned: 0 in 0.615s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.419s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.209s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860718063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082519bc-bb0a-4431-8dc9-2cc76137e5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:32Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Creating volume 082519bc-bb0a-4431-8dc9-2cc76137e5f1 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:41:42 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:42 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 1073741824 Jul 05 17:41:42 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-1077d955-4532-4dc5-814e-f9d6ba33e240 tempest-ProjectReaderTests-1032370073 None] Create snapshot completed successfully Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9aefc07d-bd10-40dc-8baa-e098f090c42a tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-b41b3578-dc47-4301-a3a2-722e8cdfcf9f-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9aefc07d-bd10-40dc-8baa-e098f090c42a tempest-ProjectReaderTests-1032370073 None] Lock "cinder-b41b3578-dc47-4301-a3a2-722e8cdfcf9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:42 devstack cinder-volume[86459]: INFO cinder.message.api [None req-9aefc07d-bd10-40dc-8baa-e098f090c42a tempest-ProjectReaderTests-1032370073 None] Creating message record for request_id = req-9aefc07d-bd10-40dc-8baa-e098f090c42a Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9aefc07d-bd10-40dc-8baa-e098f090c42a tempest-ProjectReaderTests-1032370073 None] Lock "cinder-b41b3578-dc47-4301-a3a2-722e8cdfcf9f-delete_snapshot" released by "delete_snapshot" :: held 0.063s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server [None req-9aefc07d-bd10-40dc-8baa-e098f090c42a tempest-ProjectReaderTests-1032370073 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 17:41:42 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-quobyte-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbf1704-8190-4614-880c-760ac8049b19]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:42 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 1073741824" returned: 0 in 0.854s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:43 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a Jul 05 17:41:43 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:43 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 Jul 05 17:41:43 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:43 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" returned: 0 in 0.734s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:43 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a Jul 05 17:41:43 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:43 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1" returned: 0 in 0.666s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d03e813-b7c6-4ee7-bfeb-832f597db512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa845e0e-2573-4c79-9338-df31d97ed372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:43 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Volume volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 (082519bc-bb0a-4431-8dc9-2cc76137e5f1): created successfully Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa845e0e-2573-4c79-9338-df31d97ed372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:43 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (b4372eeb-5d0e-484c-b4b9-5d5a176f35b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:43 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-35b6be57-cd23-4eb9-8e42-d00228366795 tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:41:44 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" returned: 0 in 0.685s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a" released by "delete_volume" :: held 1.478s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Created reservations ['49ef0f3c-21e6-40be-afa8-6877db5039b8', '3ee16e02-071c-45e9-97f3-56318171c071', 'dc517162-8756-4e77-b0f1-2b23a5e7e58b', 'b042bdcb-35d1-4414-828f-bf19167dc5e3'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:44 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:41:44 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-93fcc003-8be9-4758-85ff-7d6baff53049-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-93fcc003-8be9-4758-85ff-7d6baff53049-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Creating offline snapshot 0efc2b97-0beb-47d7-ac32-8dcc46057556 of volume 082519bc-bb0a-4431-8dc9-2cc76137e5f1 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "cinder-quobyte-93fcc003-8be9-4758-85ff-7d6baff53049" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cf277e-de85-4c30-bb48-e8bee7ba25d6]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-93fcc003-8be9-4758-85ff-7d6baff53049" acquired by "delete_volume" :: waited 0.032s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4809c9-2d21-46c6-ab13-83fa06b90a9a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:45 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.730s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:41:45 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Deleted volume successfully. Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-ef4abdbf-fece-40a2-a470-22d7cd8a0e19 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-e668c1ae-f5ff-43b1-b1de-1fa3ac66e60a-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:45 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 Jul 05 17:41:45 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:45 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 Jul 05 17:41:45 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:45 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1" returned: 0 in 0.789s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:45 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 1G Jul 05 17:41:45 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:45 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049" returned: 0 in 0.807s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:45 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049 Jul 05 17:41:45 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:46 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 1G" returned: 0 in 0.757s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:46 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-93fcc003-8be9-4758-85ff-7d6baff53049" returned: 0 in 0.698s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-quobyte-93fcc003-8be9-4758-85ff-7d6baff53049" released by "delete_volume" :: held 1.555s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:46 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 Jul 05 17:41:46 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Created reservations ['c1a19321-2d50-4066-9a37-e6ab1d3843cb', '52616e21-8f93-48d4-8c07-2b8de4c9b000', 'a7131058-b824-4914-96d3-41d276bea145', 'da9fe30d-8909-4776-aed3-ed6d03dce35b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:46 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:41:46 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:47 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556" returned: 0 in 0.717s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:47 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 is being set with open permissions: ugo+rw Jul 05 17:41:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:47 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 Jul 05 17:41:47 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:47 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.684s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:47 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:41:47 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Deleted volume successfully. Jul 05 17:41:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-0c6e598c-05be-4970-8815-56a156a34887 tempest-SnapshotDependencyTests-1317698780 None] Lock "cinder-93fcc003-8be9-4758-85ff-7d6baff53049-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:48 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556" returned: 0 in 0.677s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:48 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.info Jul 05 17:41:48 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:48 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.info" returned: 0 in 0.648s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:48 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.info is being set with open permissions: ugo+rw Jul 05 17:41:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:48 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.info Jul 05 17:41:48 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:49 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.info" returned: 0 in 0.722s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.466s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:49 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e8e269ae-f999-490d-bea9-f608c9b97aa3 tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-0efc2b97-0beb-47d7-ac32-8dcc46057556-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Lock "cinder-0efc2b97-0beb-47d7-ac32-8dcc46057556-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-082519bc-bb0a-4431-8dc9-2cc76137e5f1" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-082519bc-bb0a-4431-8dc9-2cc76137e5f1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-0efc2b97-0beb-47d7-ac32-8dcc46057556" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-0efc2b97-0beb-47d7-ac32-8dcc46057556" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot 0efc2b97-0beb-47d7-ac32-8dcc46057556 of volume 082519bc-bb0a-4431-8dc9-2cc76137e5f1 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[31616575-9822-4078-83c5-85661957e081]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:50 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 Jul 05 17:41:50 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:50 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:41:50 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:51 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556" returned: 0 in 0.913s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb05f65a-d7ab-45b1-8b6c-e40f2512e09f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:51 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 Jul 05 17:41:51 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:51 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.696s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:41:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:41:52 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1" returned: 0 in 0.815s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:52 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 Jul 05 17:41:52 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:52 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556" returned: 0 in 0.752s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:52 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556 Jul 05 17:41:52 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:53 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1.0efc2b97-0beb-47d7-ac32-8dcc46057556" returned: 0 in 0.674s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-0efc2b97-0beb-47d7-ac32-8dcc46057556" released by "_delete_snapshot" :: held 3.272s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-082519bc-bb0a-4431-8dc9-2cc76137e5f1" released by "delete_snapshot" :: held 3.294s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:53 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Created reservations ['b739beb3-33d3-42ee-a8be-e01bdb29ea9c', 'fc1a7e99-79d2-419d-aa46-e4bc9633b3ac', 'df43b048-57f2-4dca-a55a-e5e098a4387f', '674599ec-0a9f-42ef-971d-fff3139f64c1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:53 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:41:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6e4d5236-3888-4c4d-ba29-33885e80cb5f tempest-ProjectMemberTests-514811562 None] Lock "cinder-0efc2b97-0beb-47d7-ac32-8dcc46057556-delete_snapshot" released by "delete_snapshot" :: held 3.462s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-082519bc-bb0a-4431-8dc9-2cc76137e5f1-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Lock "cinder-082519bc-bb0a-4431-8dc9-2cc76137e5f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-082519bc-bb0a-4431-8dc9-2cc76137e5f1" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:41:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-082519bc-bb0a-4431-8dc9-2cc76137e5f1" acquired by "delete_volume" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:41:54 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[db466275-20e7-4b07-9d42-642b7bea21eb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:54 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 Jul 05 17:41:54 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:55 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1" returned: 0 in 0.825s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:55 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1 Jul 05 17:41:55 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:56 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-082519bc-bb0a-4431-8dc9-2cc76137e5f1" returned: 0 in 0.706s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-082519bc-bb0a-4431-8dc9-2cc76137e5f1" released by "delete_volume" :: held 1.597s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Created reservations ['8694b394-144b-4dd6-b4fa-fa9ad8cd709d', '59e8826f-5899-4cee-9904-76379e13ccd6', '9b24b72b-08de-4633-ac76-e4130165fc06', '8a136c6e-d1d7-4202-b727-36c22223ad1c'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:56 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:41:56 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:57 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.647s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:41:57 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8cc4c7d0-02c7-4e2f-ba9f-1588fba0b15e tempest-ProjectMemberTests-514811562 None] Lock "cinder-082519bc-bb0a-4431-8dc9-2cc76137e5f1-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (f2906f81-0165-4fca-a77e-45961d624f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb16aab1-eae0-4452-be19-3abdd58d2ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb16aab1-eae0-4452-be19-3abdd58d2ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335649623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6039dc6d-3e7e-45e1-b015-202b70597264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:57Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51cac346-f35c-4e91-bb74-f8609d099820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51cac346-f35c-4e91-bb74-f8609d099820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ec655-e0cb-41b4-9835-bdee15b0bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ec655-e0cb-41b4-9835-bdee15b0bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6039dc6d-3e7e-45e1-b015-202b70597264', 'volume_name': 'volume-6039dc6d-3e7e-45e1-b015-202b70597264', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa26397b-8e75-42e7-8329-90941dc56171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa26397b-8e75-42e7-8329-90941dc56171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19258ce-86ba-46e0-b935-bd34380ab675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:57 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Volume 6039dc6d-3e7e-45e1-b015-202b70597264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6039dc6d-3e7e-45e1-b015-202b70597264', 'volume_size': 1} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335649623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6039dc6d-3e7e-45e1-b015-202b70597264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:41:57Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Creating volume 6039dc6d-3e7e-45e1-b015-202b70597264 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:41:57 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:41:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:57 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 1073741824 Jul 05 17:41:57 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:58 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 1073741824" returned: 0 in 0.782s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:58 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 Jul 05 17:41:58 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:41:58 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264" returned: 0 in 0.609s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19258ce-86ba-46e0-b935-bd34380ab675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6039dc6d-3e7e-45e1-b015-202b70597264', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90145eaf-d887-4f44-800c-272bfc7deff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:41:58 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Volume volume-6039dc6d-3e7e-45e1-b015-202b70597264 (6039dc6d-3e7e-45e1-b015-202b70597264): created successfully Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90145eaf-d887-4f44-800c-272bfc7deff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:41:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (f2906f81-0165-4fca-a77e-45961d624f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:41:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-06d3550e-a391-441e-999d-49f3cbabbc92 tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:41:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:41:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:41:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Creating offline snapshot 09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 of volume 6039dc6d-3e7e-45e1-b015-202b70597264 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:41:59 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[26480e08-a551-4a25-8115-d533b17307d6]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:41:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:41:59 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 Jul 05 17:41:59 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:00 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264" returned: 0 in 0.758s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:00 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 1G Jul 05 17:42:00 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:01 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 1G" returned: 0 in 0.750s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6039dc6d-3e7e-45e1-b015-202b70597264 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:01 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6039dc6d-3e7e-45e1-b015-202b70597264 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 Jul 05 17:42:01 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:01 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6039dc6d-3e7e-45e1-b015-202b70597264 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6" returned: 0 in 0.711s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:01 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 is being set with open permissions: ugo+rw Jul 05 17:42:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:01 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 Jul 05 17:42:01 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:02 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6" returned: 0 in 0.614s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:02 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.info Jul 05 17:42:02 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:03 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.info" returned: 0 in 0.609s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:03 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.info is being set with open permissions: ugo+rw Jul 05 17:42:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:03 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.info Jul 05 17:42:03 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:03 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.info" returned: 0 in 0.689s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.205s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:42:03 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-340f6954-8a42-4b55-90b0-00d2b169bfa7 tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Lock "cinder-09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-6039dc6d-3e7e-45e1-b015-202b70597264" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-6039dc6d-3e7e-45e1-b015-202b70597264" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot 09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 of volume 6039dc6d-3e7e-45e1-b015-202b70597264 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a632c91-dba6-4e25-9565-c1b710a6ec9f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:42:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:04 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 Jul 05 17:42:04 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:05 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6" returned: 0 in 0.764s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6039dc6d-3e7e-45e1-b015-202b70597264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:42:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a91bccf-6026-42f6-9b50-f90d942e5c42]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:42:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:05 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 Jul 05 17:42:05 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:06 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264" returned: 0 in 0.740s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:06 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 Jul 05 17:42:06 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:07 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6" returned: 0 in 0.714s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:07 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6 Jul 05 17:42:07 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:07 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264.09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6" returned: 0 in 0.610s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6" released by "_delete_snapshot" :: held 2.917s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-6039dc6d-3e7e-45e1-b015-202b70597264" released by "delete_snapshot" :: held 2.938s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Created reservations ['9fc095b0-6574-4cb4-9462-8dcb7e4ae51d', '28880937-b808-4278-b451-52706a3c2ce1', '7da1aafb-2f72-4329-9119-776a69d91b02', '31066836-586c-41d7-910c-c5f6d04e4d44'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:42:07 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9c59b527-59dd-4931-8505-96a61dc7c95c tempest-ProjectMemberTests-514811562 None] Lock "cinder-09dd1b5d-5d2c-42a2-8809-2cf7f73d4cc6-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-6039dc6d-3e7e-45e1-b015-202b70597264-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Lock "cinder-6039dc6d-3e7e-45e1-b015-202b70597264-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-6039dc6d-3e7e-45e1-b015-202b70597264" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:42:07 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-6039dc6d-3e7e-45e1-b015-202b70597264" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:42:08 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab690c-7f57-40ff-9e5b-3c08adb8cbf5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:42:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:08 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 Jul 05 17:42:08 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:08 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264" returned: 0 in 0.733s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:08 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264 Jul 05 17:42:08 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:09 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-6039dc6d-3e7e-45e1-b015-202b70597264" returned: 0 in 0.722s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-6039dc6d-3e7e-45e1-b015-202b70597264" released by "delete_volume" :: held 1.510s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Created reservations ['791413f3-858c-49a8-b4a7-352543b18f5b', 'd1fa17c3-c8f4-400d-8fc2-dbd7eb413aed', '93195b2a-8232-4b1e-bf0a-7aeabbcc0fb0', '40344cdd-8d33-46f9-ad01-242556500ace'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:42:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:09 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:42:09 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:10 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.622s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:42:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-686c1663-2cb5-4490-8cd7-ef1c1f065833 tempest-ProjectMemberTests-514811562 None] Lock "cinder-6039dc6d-3e7e-45e1-b015-202b70597264-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (108803a2-91cc-4e30-93a5-f44611096d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d46131d-d987-4266-ae69-0017f5272020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d46131d-d987-4266-ae69-0017f5272020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-194868815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dba904-cbd8-43b3-91d9-bb7fa90c2b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:42:11Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25966b8a-2e6f-4b6d-9277-b00d07aefcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25966b8a-2e6f-4b6d-9277-b00d07aefcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84383205-9136-495a-afbf-d410d537eb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84383205-9136-495a-afbf-d410d537eb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75dba904-cbd8-43b3-91d9-bb7fa90c2b63', 'volume_name': 'volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5938c399-abb0-4f58-bdc7-f8f39d686196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5938c399-abb0-4f58-bdc7-f8f39d686196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c145eb-dc4a-4138-8111-7dd7090c75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:42:10 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Volume 75dba904-cbd8-43b3-91d9-bb7fa90c2b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63', 'volume_size': 1} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-194868815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dba904-cbd8-43b3-91d9-bb7fa90c2b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:42:11Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Creating volume 75dba904-cbd8-43b3-91d9-bb7fa90c2b63 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:42:10 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:42:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:10 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 1073741824 Jul 05 17:42:10 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:11 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 1073741824" returned: 0 in 0.774s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:11 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 Jul 05 17:42:11 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:12 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63" returned: 0 in 0.621s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c145eb-dc4a-4138-8111-7dd7090c75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853f3d6e-9590-4d0a-b0a8-8c554a11ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:42:12 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Volume volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 (75dba904-cbd8-43b3-91d9-bb7fa90c2b63): created successfully Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853f3d6e-9590-4d0a-b0a8-8c554a11ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (108803a2-91cc-4e30-93a5-f44611096d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:42:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-e2050a5e-44c2-4612-8b87-05f8630b1c33 tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Creating offline snapshot 536a5735-33b3-4351-b154-53afda4ea497 of volume 75dba904-cbd8-43b3-91d9-bb7fa90c2b63 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21edc89-0025-429b-9e3f-f725bf9a9530]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:42:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:12 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 Jul 05 17:42:12 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:13 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63" returned: 0 in 0.717s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:13 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497 1G Jul 05 17:42:13 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:14 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497 1G" returned: 0 in 0.765s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:14 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497 Jul 05 17:42:14 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:15 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497" returned: 0 in 0.692s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:15 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497 is being set with open permissions: ugo+rw Jul 05 17:42:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:15 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497 Jul 05 17:42:15 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:15 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.536a5735-33b3-4351-b154-53afda4ea497" returned: 0 in 0.648s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:15 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.info Jul 05 17:42:15 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:16 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.info" returned: 0 in 0.684s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:16 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.info is being set with open permissions: ugo+rw Jul 05 17:42:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:16 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.info Jul 05 17:42:16 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:17 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-75dba904-cbd8-43b3-91d9-bb7fa90c2b63.info" returned: 0 in 0.681s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:42:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a922eaa0-2c89-4af6-8866-cefc9a1bbca4 tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:42:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3dc530e0-19cf-40f9-b7b6-ac1229c289a7 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-536a5735-33b3-4351-b154-53afda4ea497-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:42:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3dc530e0-19cf-40f9-b7b6-ac1229c289a7 tempest-ProjectMemberTests-514811562 None] Lock "cinder-536a5735-33b3-4351-b154-53afda4ea497-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:42:18 devstack cinder-volume[86459]: INFO cinder.message.api [None req-3dc530e0-19cf-40f9-b7b6-ac1229c289a7 tempest-ProjectMemberTests-514811562 None] Creating message record for request_id = req-3dc530e0-19cf-40f9-b7b6-ac1229c289a7 Jul 05 17:42:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-3dc530e0-19cf-40f9-b7b6-ac1229c289a7 tempest-ProjectMemberTests-514811562 None] Lock "cinder-536a5735-33b3-4351-b154-53afda4ea497-delete_snapshot" released by "delete_snapshot" :: held 0.031s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server [None req-3dc530e0-19cf-40f9-b7b6-ac1229c289a7 tempest-ProjectMemberTests-514811562 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 17:42:18 devstack cinder-volume[86459]: ERROR oslo_messaging.rpc.server Jul 05 17:42:28 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:INSERT=22,cinder:UPDATE=97,cinder:SELECT=72,cinder:DELETE=7 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:42:28 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=65,cinder:INSERT=27,cinder:UPDATE=81,cinder:DELETE=9 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:42:48 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:42:48 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:42:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:42:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:42:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:42:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:42:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:42:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:42:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:42:50 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:42:50 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:42:51 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 05 17:42:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.622s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:42:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:42:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:42:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:42:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:43:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:43:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:43:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:43:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:43:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:43:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:43:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:43:50 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:43:50 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:43:51 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 05 17:43:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.617s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:43:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:43:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:43:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:43:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:44:48 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:44:48 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=1 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:44:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:44:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:44:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:44:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:44:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:44:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:44:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:44:50 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:44:50 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:44:51 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 05 17:44:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.694s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:44:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:44:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:44:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:44:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (7b27fc1d-2a33-4b6b-9279-a7dda9448e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5feac446-8bac-43f2-8d97-0de7f514276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5feac446-8bac-43f2-8d97-0de7f514276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235361341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6df51eb-dcc0-4f8c-9b23-36b332d5852d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:44:59Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1636100c-1c35-489d-8db1-4da6199a2f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1636100c-1c35-489d-8db1-4da6199a2f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d650e2dc-7688-401f-b332-ce5400c9f415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d650e2dc-7688-401f-b332-ce5400c9f415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6df51eb-dcc0-4f8c-9b23-36b332d5852d', 'volume_name': 'volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155957d4-b084-4d16-961f-83e153c97ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155957d4-b084-4d16-961f-83e153c97ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:44:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde92e1b-703c-45e1-b240-c3d2442c6d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:44:59 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Volume e6df51eb-dcc0-4f8c-9b23-36b332d5852d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d', 'volume_size': 1} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235361341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6df51eb-dcc0-4f8c-9b23-36b332d5852d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:44:59Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Creating volume e6df51eb-dcc0-4f8c-9b23-36b332d5852d {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:44:59 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:44:59 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d 1073741824 Jul 05 17:44:59 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:44:59 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d 1073741824" returned: 0 in 0.801s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:44:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:44:59 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d Jul 05 17:44:59 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:00 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" returned: 0 in 0.618s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:45:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde92e1b-703c-45e1-b240-c3d2442c6d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5608acca-279f-4b19-add7-2103dbd6770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:00 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Volume volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d (e6df51eb-dcc0-4f8c-9b23-36b332d5852d): created successfully Jul 05 17:45:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5608acca-279f-4b19-add7-2103dbd6770d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:00 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (7b27fc1d-2a33-4b6b-9279-a7dda9448e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-687622e3-82a9-4b21-84fe-75acf8d838d8 tempest-ProjectReaderTests-1032370073 None] Created volume successfully. Jul 05 17:45:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Creating offline snapshot b42cbd84-175b-4edc-a323-9927b20248cc of volume e6df51eb-dcc0-4f8c-9b23-36b332d5852d {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:45:01 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0d7aad-5be7-419a-aef6-002076b60501]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:01 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d Jul 05 17:45:01 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:01 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" returned: 0 in 0.729s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:01 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc 1G Jul 05 17:45:01 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:02 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc 1G" returned: 0 in 0.765s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:02 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc Jul 05 17:45:02 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:03 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc" returned: 0 in 0.664s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:03 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc is being set with open permissions: ugo+rw Jul 05 17:45:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:03 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc Jul 05 17:45:03 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:03 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc" returned: 0 in 0.609s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:03 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.info Jul 05 17:45:03 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:04 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.info" returned: 0 in 0.608s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:04 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.info is being set with open permissions: ugo+rw Jul 05 17:45:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:04 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.info Jul 05 17:45:04 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:05 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.info" returned: 0 in 0.606s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.051s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:05 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-192da2df-c026-4b15-8cfe-5e145f730872 tempest-ProjectReaderTests-1032370073 None] Create snapshot completed successfully Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-b42cbd84-175b-4edc-a323-9927b20248cc-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-b42cbd84-175b-4edc-a323-9927b20248cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-b42cbd84-175b-4edc-a323-9927b20248cc" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-b42cbd84-175b-4edc-a323-9927b20248cc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Deleting offline snapshot b42cbd84-175b-4edc-a323-9927b20248cc of volume e6df51eb-dcc0-4f8c-9b23-36b332d5852d {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] snapshot_file for this snap is: volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa70bb01-a95a-4e54-b1fb-dedbec0f164b]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:05 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc Jul 05 17:45:05 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:06 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc" returned: 0 in 0.755s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:45:06 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[a051c4a8-2698-4b56-8464-7d25b672ee67]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:06 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d Jul 05 17:45:06 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:06 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" returned: 0 in 0.721s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:06 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc Jul 05 17:45:06 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:07 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc" returned: 0 in 0.703s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:07 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc Jul 05 17:45:07 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:08 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d.b42cbd84-175b-4edc-a323-9927b20248cc" returned: 0 in 0.637s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-b42cbd84-175b-4edc-a323-9927b20248cc" released by "_delete_snapshot" :: held 2.897s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" released by "delete_snapshot" :: held 2.915s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Created reservations ['66f2680a-7c24-4836-9088-fbd60999782d', '783b63d1-8c2a-4a9d-b185-ff69dc904406', '8c48a3c3-e6ba-44c2-952c-282f3894e2f8', 'c10a709d-9a86-4aaa-bd15-1a07456bc8ac'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:08 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Delete snapshot completed successfully. Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-4e0deb25-012b-4ba2-af0e-862d57c91166 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-b42cbd84-175b-4edc-a323-9927b20248cc-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-e6df51eb-dcc0-4f8c-9b23-36b332d5852d-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-e6df51eb-dcc0-4f8c-9b23-36b332d5852d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f685b219-4fe3-4950-9859-b9040cac9f80]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:08 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d Jul 05 17:45:08 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:09 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" returned: 0 in 0.735s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:09 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d Jul 05 17:45:09 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:09 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" returned: 0 in 0.618s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:09 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-e6df51eb-dcc0-4f8c-9b23-36b332d5852d" released by "delete_volume" :: held 1.404s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:09 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Created reservations ['197a1798-6b8f-4d2a-93b4-64ae39364b93', '9628743d-0940-45ad-82a0-d3e7ade34528', '293f8e0d-8c2e-416d-8def-f373ff9ca487', '6031df0c-1164-4200-b9ef-696456dbf496'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:10 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:45:10 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:10 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.640s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:45:10 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Deleted volume successfully. Jul 05 17:45:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-28ee36be-6e75-4736-aa4d-82eea9d15169 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-e6df51eb-dcc0-4f8c-9b23-36b332d5852d-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (0b3e674b-445e-41e6-b67c-b13e89823b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7e7316-ef8e-4841-8a21-d7510a9d0914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7e7316-ef8e-4841-8a21-d7510a9d0914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720503103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f121c7da-6c33-48c2-996b-340d5651cbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:11Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1f0ef6-7714-439b-8529-aa7f1a85bb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1f0ef6-7714-439b-8529-aa7f1a85bb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be75206-c138-496e-b2b1-99f0da3a3fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be75206-c138-496e-b2b1-99f0da3a3fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f121c7da-6c33-48c2-996b-340d5651cbad', 'volume_name': 'volume-f121c7da-6c33-48c2-996b-340d5651cbad', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f173c91a-3d27-4e53-8521-936ebfee41fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f173c91a-3d27-4e53-8521-936ebfee41fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48829123-e79f-444c-b941-bc97c7c2d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:11 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Volume f121c7da-6c33-48c2-996b-340d5651cbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f121c7da-6c33-48c2-996b-340d5651cbad', 'volume_size': 1} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720503103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f121c7da-6c33-48c2-996b-340d5651cbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:11Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Creating volume f121c7da-6c33-48c2-996b-340d5651cbad {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:45:11 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:45:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:11 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad 1073741824 Jul 05 17:45:11 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:12 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad 1073741824" returned: 0 in 0.790s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:12 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad Jul 05 17:45:12 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:12 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad" returned: 0 in 0.603s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48829123-e79f-444c-b941-bc97c7c2d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f121c7da-6c33-48c2-996b-340d5651cbad', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dc392f-3944-400c-b381-42d79be16b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:12 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Volume volume-f121c7da-6c33-48c2-996b-340d5651cbad (f121c7da-6c33-48c2-996b-340d5651cbad): created successfully Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dc392f-3944-400c-b381-42d79be16b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:12 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (0b3e674b-445e-41e6-b67c-b13e89823b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:12 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-db6aec50-bf90-4a27-9e28-64c00662fed9 tempest-ProjectReaderTests-1032370073 None] Created volume successfully. Jul 05 17:45:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Creating offline snapshot d2314df6-81c9-4eb9-bba6-c3fb99532090 of volume f121c7da-6c33-48c2-996b-340d5651cbad {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:45:13 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a971e58-28eb-4c9e-97f4-a97aa5232c17]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:13 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad Jul 05 17:45:13 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:14 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad" returned: 0 in 0.717s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:14 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 1G Jul 05 17:45:14 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:14 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 1G" returned: 0 in 0.773s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f121c7da-6c33-48c2-996b-340d5651cbad -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:14 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f121c7da-6c33-48c2-996b-340d5651cbad -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 Jul 05 17:45:14 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:15 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f121c7da-6c33-48c2-996b-340d5651cbad -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090" returned: 0 in 0.657s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:15 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 is being set with open permissions: ugo+rw Jul 05 17:45:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:15 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 Jul 05 17:45:15 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:16 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090" returned: 0 in 0.611s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:16 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.info Jul 05 17:45:16 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:16 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.info" returned: 0 in 0.619s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:16 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.info is being set with open permissions: ugo+rw Jul 05 17:45:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:16 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.info Jul 05 17:45:16 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:17 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.info" returned: 0 in 0.617s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.066s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:17 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f4dd3706-3178-4bc7-8cd5-82e3cfcbf1e1 tempest-ProjectReaderTests-1032370073 None] Create snapshot completed successfully Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-d2314df6-81c9-4eb9-bba6-c3fb99532090-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Lock "cinder-d2314df6-81c9-4eb9-bba6-c3fb99532090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-f121c7da-6c33-48c2-996b-340d5651cbad" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-f121c7da-6c33-48c2-996b-340d5651cbad" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-d2314df6-81c9-4eb9-bba6-c3fb99532090" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-d2314df6-81c9-4eb9-bba6-c3fb99532090" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Deleting offline snapshot d2314df6-81c9-4eb9-bba6-c3fb99532090 of volume f121c7da-6c33-48c2-996b-340d5651cbad {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] snapshot_file for this snap is: volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6ab0d0-6024-4ee4-908a-e209f75ffd9f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:17 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 Jul 05 17:45:17 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:18 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090" returned: 0 in 0.721s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:18 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f121c7da-6c33-48c2-996b-340d5651cbad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:45:18 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fbfc37-d021-4522-b276-dea016d43243]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:18 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad Jul 05 17:45:18 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:19 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad" returned: 0 in 0.763s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:19 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 Jul 05 17:45:19 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:19 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090" returned: 0 in 0.742s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:19 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090 Jul 05 17:45:19 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:20 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad.d2314df6-81c9-4eb9-bba6-c3fb99532090" returned: 0 in 0.610s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-d2314df6-81c9-4eb9-bba6-c3fb99532090" released by "_delete_snapshot" :: held 2.920s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-f121c7da-6c33-48c2-996b-340d5651cbad" released by "delete_snapshot" :: held 2.941s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Created reservations ['0d56e37d-aa96-4c7a-bf93-e90d53864b1f', '324f394e-f095-4e46-a0f3-4dc374c5177c', 'c6598bbe-9fab-4894-9bf6-137fc206682f', 'd4a44254-1666-4508-b309-0a9e8f343b65'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Delete snapshot completed successfully. Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-808f9a56-7a76-4923-b301-d3a15db5b6da tempest-ProjectReaderTests-1032370073 None] Lock "cinder-d2314df6-81c9-4eb9-bba6-c3fb99532090-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-f121c7da-6c33-48c2-996b-340d5651cbad-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-f121c7da-6c33-48c2-996b-340d5651cbad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-f121c7da-6c33-48c2-996b-340d5651cbad" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-f121c7da-6c33-48c2-996b-340d5651cbad" acquired by "delete_volume" :: waited 0.012s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[848fca9a-2525-4cdf-8277-1d210ca94571]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:20 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad Jul 05 17:45:20 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:21 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad" returned: 0 in 0.752s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:21 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad Jul 05 17:45:21 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:22 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f121c7da-6c33-48c2-996b-340d5651cbad" returned: 0 in 0.663s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-f121c7da-6c33-48c2-996b-340d5651cbad" released by "delete_volume" :: held 1.466s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Created reservations ['a683afc7-7605-4df8-8bfa-76fbf60c0eee', 'b5a2147c-5aa8-4cdd-a26b-3610a8119de0', '05f07167-c814-485f-92b9-e8bb6e8a44c6', '19edd774-f783-47d5-88e4-69702d680626'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:22 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:45:22 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:23 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.664s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:45:23 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Deleted volume successfully. Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-48569194-6c08-4cc5-80eb-b07c2c6e8730 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-f121c7da-6c33-48c2-996b-340d5651cbad-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (89dfe003-8016-4a11-aea4-d2fe0700f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c790ad-4979-4d8c-865b-95069a038ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c790ad-4979-4d8c-865b-95069a038ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667568257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2327a6bf-b217-4275-8bfc-d4761b192957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:23Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3a14b4-33f1-4f03-b0d6-220521afc877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3a14b4-33f1-4f03-b0d6-220521afc877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53c679f-e6c4-4f20-ae25-978479427f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53c679f-e6c4-4f20-ae25-978479427f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2327a6bf-b217-4275-8bfc-d4761b192957', 'volume_name': 'volume-2327a6bf-b217-4275-8bfc-d4761b192957', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff29b939-3870-408c-a6d7-ed0d7b953161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff29b939-3870-408c-a6d7-ed0d7b953161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7018b1ea-d162-4805-abfb-a2fd3076b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:23 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Volume 2327a6bf-b217-4275-8bfc-d4761b192957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2327a6bf-b217-4275-8bfc-d4761b192957', 'volume_size': 1} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667568257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2327a6bf-b217-4275-8bfc-d4761b192957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88952d19d3d24c20bb7c8528eaad1bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:23Z,use_quota=True,user_id='73592ec3a53c42cdb130914da28ee108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Creating volume 2327a6bf-b217-4275-8bfc-d4761b192957 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:45:23 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:45:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:23 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 1073741824 Jul 05 17:45:23 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:24 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 1073741824" returned: 0 in 0.769s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:24 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 Jul 05 17:45:24 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:24 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957" returned: 0 in 0.677s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:24 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:45:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:24 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7018b1ea-d162-4805-abfb-a2fd3076b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2327a6bf-b217-4275-8bfc-d4761b192957', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1972d12d-d813-441e-8363-489c3c4f91fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:25 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Volume volume-2327a6bf-b217-4275-8bfc-d4761b192957 (2327a6bf-b217-4275-8bfc-d4761b192957): created successfully Jul 05 17:45:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1972d12d-d813-441e-8363-489c3c4f91fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:25 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Flow 'volume_create_manager' (89dfe003-8016-4a11-aea4-d2fe0700f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-593fa594-e8a8-4ca4-b69d-61e11403c531 tempest-ProjectReaderTests-1032370073 None] Created volume successfully. Jul 05 17:45:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:25 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Creating offline snapshot 9150245f-49b3-4e33-a20f-a8496fe89bcd of volume 2327a6bf-b217-4275-8bfc-d4761b192957 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:45:25 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ae45a0-a79a-4f0e-b2ee-641568680d0f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:25 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 Jul 05 17:45:25 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:26 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957" returned: 0 in 0.727s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:26 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd 1G Jul 05 17:45:26 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:27 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd 1G" returned: 0 in 0.744s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2327a6bf-b217-4275-8bfc-d4761b192957 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:27 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2327a6bf-b217-4275-8bfc-d4761b192957 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd Jul 05 17:45:27 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:27 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2327a6bf-b217-4275-8bfc-d4761b192957 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd" returned: 0 in 0.677s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:27 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd is being set with open permissions: ugo+rw Jul 05 17:45:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:27 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd Jul 05 17:45:27 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:28 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd" returned: 0 in 0.621s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:28 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.info Jul 05 17:45:28 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:29 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.info" returned: 0 in 0.621s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:29 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.info is being set with open permissions: ugo+rw Jul 05 17:45:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:29 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.info Jul 05 17:45:29 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:29 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.info" returned: 0 in 0.623s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.092s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-1a60e33d-9483-4765-bfce-31fff82280f2 tempest-ProjectReaderTests-1032370073 None] Create snapshot completed successfully Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-9150245f-49b3-4e33-a20f-a8496fe89bcd-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-9150245f-49b3-4e33-a20f-a8496fe89bcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-2327a6bf-b217-4275-8bfc-d4761b192957" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-2327a6bf-b217-4275-8bfc-d4761b192957" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-9150245f-49b3-4e33-a20f-a8496fe89bcd" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-9150245f-49b3-4e33-a20f-a8496fe89bcd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Deleting offline snapshot 9150245f-49b3-4e33-a20f-a8496fe89bcd of volume 2327a6bf-b217-4275-8bfc-d4761b192957 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] snapshot_file for this snap is: volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadaec22-55b8-44a6-82ec-93edb267ae93]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:31 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd Jul 05 17:45:31 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:31 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd" returned: 0 in 0.731s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2327a6bf-b217-4275-8bfc-d4761b192957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:45:31 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cb38c3-4be1-4114-9ad6-02e07f935936]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:31 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 Jul 05 17:45:31 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:32 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957" returned: 0 in 0.713s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:32 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd Jul 05 17:45:32 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:33 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd" returned: 0 in 0.761s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:33 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd Jul 05 17:45:33 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:33 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957.9150245f-49b3-4e33-a20f-a8496fe89bcd" returned: 0 in 0.747s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-9150245f-49b3-4e33-a20f-a8496fe89bcd" released by "_delete_snapshot" :: held 3.046s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:33 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-2327a6bf-b217-4275-8bfc-d4761b192957" released by "delete_snapshot" :: held 3.069s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Created reservations ['de8896b3-aeb8-4404-8cac-b12db951de49', 'bb5fbc20-bff2-41a9-86a5-85bd886627df', '99387c52-80ae-4e0c-89ed-ff1245e25d59', '01316c17-b13c-4606-8372-29b1a8e79ace'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:34 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Delete snapshot completed successfully. Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-9d7bb718-a9ba-4fe5-adb4-e3b39b73e427 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-9150245f-49b3-4e33-a20f-a8496fe89bcd-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (0e38877f-9ced-4615-9a7e-28b6b4750df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30443b76-2503-473c-b2dd-44107577acc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30443b76-2503-473c-b2dd-44107577acc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843291134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffbfb1e-0f7a-4190-97c8-d5deee1b97b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:34Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de622f1-539f-403b-b5a7-311869bce07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de622f1-539f-403b-b5a7-311869bce07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4aadd7-20de-4806-a855-c51e1198f559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4aadd7-20de-4806-a855-c51e1198f559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bffbfb1e-0f7a-4190-97c8-d5deee1b97b9', 'volume_name': 'volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a144d6-3120-4ba6-8064-ef31f706a178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a144d6-3120-4ba6-8064-ef31f706a178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bf36cc-9319-4319-9337-641028389aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:34 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Volume bffbfb1e-0f7a-4190-97c8-d5deee1b97b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9', 'volume_size': 1} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843291134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffbfb1e-0f7a-4190-97c8-d5deee1b97b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:34Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Creating volume bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:45:34 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:45:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:34 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 1073741824 Jul 05 17:45:34 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-2327a6bf-b217-4275-8bfc-d4761b192957-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-2327a6bf-b217-4275-8bfc-d4761b192957-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "cinder-quobyte-2327a6bf-b217-4275-8bfc-d4761b192957" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:35 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 1073741824" returned: 0 in 0.886s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-2327a6bf-b217-4275-8bfc-d4761b192957" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7190b18-7440-41a3-8b7b-dea79c35b5ad]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:35 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 Jul 05 17:45:35 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:35 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 Jul 05 17:45:35 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:35 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" returned: 0 in 0.677s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bf36cc-9319-4319-9337-641028389aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed8a11-2c26-4af8-905d-e84bfa3ca3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:35 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Volume volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 (bffbfb1e-0f7a-4190-97c8-d5deee1b97b9): created successfully Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed8a11-2c26-4af8-905d-e84bfa3ca3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:35 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (0e38877f-9ced-4615-9a7e-28b6b4750df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:36 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-69b73477-d5d4-4d80-b20a-624899e3b732 tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:45:36 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957" returned: 0 in 0.802s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:36 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957 Jul 05 17:45:36 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Creating offline snapshot 9c5653ee-8c9b-4573-856b-40bfd9c9e3dc of volume bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c6f079-4fc3-4719-ad2d-1f9b2c035c79]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:36 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-2327a6bf-b217-4275-8bfc-d4761b192957" returned: 0 in 0.685s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-quobyte-2327a6bf-b217-4275-8bfc-d4761b192957" released by "delete_volume" :: held 1.559s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:36 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 Jul 05 17:45:36 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Created reservations ['e7f41894-cffa-4386-ad0a-b22f8b6d8806', 'eb588a53-ac7e-44df-a456-ad555d36da89', 'a23b5b9e-d8a6-4751-a361-0059fe47a288', '54f95b69-5b11-4f1c-aebe-bb06189fd9cf'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:36 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:45:36 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:37 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" returned: 0 in 0.818s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:37 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc 1G Jul 05 17:45:37 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:37 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.710s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:37 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:45:37 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Deleted volume successfully. Jul 05 17:45:37 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-50822b15-6391-48e8-b5f1-9dfd61af2568 tempest-ProjectReaderTests-1032370073 None] Lock "cinder-2327a6bf-b217-4275-8bfc-d4761b192957-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:38 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc 1G" returned: 0 in 0.821s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:38 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc Jul 05 17:45:38 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:39 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc" returned: 0 in 0.729s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:39 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc is being set with open permissions: ugo+rw Jul 05 17:45:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:39 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc Jul 05 17:45:39 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:39 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc" returned: 0 in 0.693s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:39 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.info Jul 05 17:45:39 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:40 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.info" returned: 0 in 0.712s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:40 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.info is being set with open permissions: ugo+rw Jul 05 17:45:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:40 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.info Jul 05 17:45:40 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:41 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.info" returned: 0 in 0.660s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.518s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:41 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-fb048fb3-ae55-49ac-b06d-88ffec952e4e tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-9c5653ee-8c9b-4573-856b-40bfd9c9e3dc-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Lock "cinder-9c5653ee-8c9b-4573-856b-40bfd9c9e3dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-9c5653ee-8c9b-4573-856b-40bfd9c9e3dc" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-9c5653ee-8c9b-4573-856b-40bfd9c9e3dc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot 9c5653ee-8c9b-4573-856b-40bfd9c9e3dc of volume bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d38f3-3ad5-47df-a19f-cc2303197f9a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:42 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc Jul 05 17:45:42 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:42 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc" returned: 0 in 0.760s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:42 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:45:42 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e3dde-fe1d-449e-9090-49cfbcb7f686]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:42 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 Jul 05 17:45:42 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:43 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" returned: 0 in 0.776s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:43 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc Jul 05 17:45:43 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:44 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc" returned: 0 in 0.734s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:44 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc Jul 05 17:45:44 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:44 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9.9c5653ee-8c9b-4573-856b-40bfd9c9e3dc" returned: 0 in 0.676s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-9c5653ee-8c9b-4573-856b-40bfd9c9e3dc" released by "_delete_snapshot" :: held 3.070s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" released by "delete_snapshot" :: held 3.097s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:45 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Created reservations ['0d564078-5bdd-42f7-9bc9-7fb57bd9d550', '7cd29ffa-b7f2-43c1-8ba2-1e83e59e3c2d', '0629dcff-7128-4ec1-b3c3-d2a38d5b5da1', '8537f069-4864-46fd-9604-231dc29a81ec'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:45 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:45:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-8b007468-8c2a-4a73-bf54-3d1e04ab93f6 tempest-ProjectMemberTests-514811562 None] Lock "cinder-9c5653ee-8c9b-4573-856b-40bfd9c9e3dc-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Lock "cinder-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:46 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:46 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7db5dc-6165-4e86-a210-23946e97db90]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:46 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:46 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 Jul 05 17:45:46 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:47 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" returned: 0 in 0.802s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:47 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9 Jul 05 17:45:47 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:47 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" returned: 0 in 0.657s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9" released by "delete_volume" :: held 1.518s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Created reservations ['1e3df7af-0808-40d5-a60a-749b33d300a5', '13ea6a5e-40ba-48bd-ae33-1e4955880093', 'd8e9d30b-d7a5-497b-a4b2-93430854416a', 'f3ac8212-8a48-4856-b71c-c8a4f20424f7'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:47 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:47 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:45:47 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:48 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:48 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.647s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:48 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:45:48 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:45:48 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-57c2eb24-7d9d-4f01-974b-b8875dc81d10 tempest-ProjectMemberTests-514811562 None] Lock "cinder-bffbfb1e-0f7a-4190-97c8-d5deee1b97b9-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (3bfb9206-5ac5-42d4-9eac-5d724b84e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c901f1-f54a-4a5e-8b3e-db76e7e09531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c901f1-f54a-4a5e-8b3e-db76e7e09531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94234462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5133216-e3cc-42ba-9ca3-989013ea928b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:49Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7de4e79-97b3-4725-afdb-46646986ac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7de4e79-97b3-4725-afdb-46646986ac6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e25c0f-94cb-490d-bb78-639430fd2ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e25c0f-94cb-490d-bb78-639430fd2ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5133216-e3cc-42ba-9ca3-989013ea928b', 'volume_name': 'volume-f5133216-e3cc-42ba-9ca3-989013ea928b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2eae411-5e83-41b1-a1de-5514968b5231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2eae411-5e83-41b1-a1de-5514968b5231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6d8e9d-467d-4641-8180-a2b520d94917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Volume f5133216-e3cc-42ba-9ca3-989013ea928b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5133216-e3cc-42ba-9ca3-989013ea928b', 'volume_size': 1} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94234462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5133216-e3cc-42ba-9ca3-989013ea928b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:49Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Creating volume f5133216-e3cc-42ba-9ca3-989013ea928b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:45:49 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:45:49 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b 1073741824 Jul 05 17:45:49 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Flow 'volume_create_manager' (f537e8b6-1964-4d98-9dbe-9ba840f04476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbb2930-02ca-4ab8-92f3-262a2d75ef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbb2930-02ca-4ab8-92f3-262a2d75ef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991297191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadf9197-fb84-4f8e-b7f3-d7d6edda0066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b8ca9b1fba4b00806b7dd41876bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:49Z,use_quota=True,user_id='bfe45ecb0af74d969979ca6ee3e92dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5f29cf-2cd7-4e08-91dd-3ed61ffba2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5f29cf-2cd7-4e08-91dd-3ed61ffba2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0026a0b-4096-48fe-8470-3b6d2c265247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0026a0b-4096-48fe-8470-3b6d2c265247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dadf9197-fb84-4f8e-b7f3-d7d6edda0066', 'volume_name': 'volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151484bd-04e5-4f03-b6c7-f683594df65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151484bd-04e5-4f03-b6c7-f683594df65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8942430-78ed-4be8-bd88-2133f68d12fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Volume dadf9197-fb84-4f8e-b7f3-d7d6edda0066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066', 'volume_size': 1} Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:49 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b 1073741824" returned: 0 in 0.817s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:50 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b Jul 05 17:45:50 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:50 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:50 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 1073741824 Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b" returned: 0 in 0.614s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991297191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadf9197-fb84-4f8e-b7f3-d7d6edda0066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b8ca9b1fba4b00806b7dd41876bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:49Z,use_quota=True,user_id='bfe45ecb0af74d969979ca6ee3e92dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Creating volume dadf9197-fb84-4f8e-b7f3-d7d6edda0066 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:50 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:45:50 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6d8e9d-467d-4641-8180-a2b520d94917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5133216-e3cc-42ba-9ca3-989013ea928b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50a02b2-a6ed-4248-8a48-7dc1a47f92a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:50 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Volume volume-f5133216-e3cc-42ba-9ca3-989013ea928b (f5133216-e3cc-42ba-9ca3-989013ea928b): created successfully Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50a02b2-a6ed-4248-8a48-7dc1a47f92a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (3bfb9206-5ac5-42d4-9eac-5d724b84e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:50 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5a695fbc-510d-4137-b5ad-6caa0641afa4 tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:50 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:45:50 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:51 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 1073741824" returned: 0 in 0.852s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:51 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.689s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:45:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:45:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:45:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:45:51 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 Jul 05 17:45:51 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:52 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066" returned: 0 in 0.659s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.913s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8942430-78ed-4be8-bd88-2133f68d12fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9db68c-7077-4143-b191-795e09a0411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Creating offline snapshot 2c99f47e-43bc-4ac0-bbc9-161a7844e6fd of volume f5133216-e3cc-42ba-9ca3-989013ea928b {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[566ae0c1-b662-49b1-84e4-c3038965e5ea]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:52 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Volume volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 (dadf9197-fb84-4f8e-b7f3-d7d6edda0066): created successfully Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9db68c-7077-4143-b191-795e09a0411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Flow 'volume_create_manager' (f537e8b6-1964-4d98-9dbe-9ba840f04476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:52 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-61a48dd0-9fb4-4c24-b567-7aae043cc1a8 tempest-ProjectReaderTests-2056459594 None] Created volume successfully. Jul 05 17:45:52 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b Jul 05 17:45:52 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:52 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b" returned: 0 in 0.721s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:52 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd 1G Jul 05 17:45:52 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Acquiring lock "cinder-dadf9197-fb84-4f8e-b7f3-d7d6edda0066-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Lock "cinder-dadf9197-fb84-4f8e-b7f3-d7d6edda0066-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Acquiring lock "cinder-quobyte-dadf9197-fb84-4f8e-b7f3-d7d6edda0066" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Lock "cinder-quobyte-dadf9197-fb84-4f8e-b7f3-d7d6edda0066" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:53 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded74e9e-db18-498e-8ec3-3db473e505b5]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:53 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 Jul 05 17:45:53 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:53 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd 1G" returned: 0 in 0.816s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5133216-e3cc-42ba-9ca3-989013ea928b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:53 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5133216-e3cc-42ba-9ca3-989013ea928b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd Jul 05 17:45:53 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:54 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066" returned: 0 in 0.770s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:54 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066 Jul 05 17:45:54 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:54 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5133216-e3cc-42ba-9ca3-989013ea928b -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd" returned: 0 in 0.697s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:54 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd is being set with open permissions: ugo+rw Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:54 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd Jul 05 17:45:54 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:54 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-dadf9197-fb84-4f8e-b7f3-d7d6edda0066" returned: 0 in 0.665s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Lock "cinder-quobyte-dadf9197-fb84-4f8e-b7f3-d7d6edda0066" released by "delete_volume" :: held 1.492s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Created reservations ['e790456c-1d28-4e39-b7a4-4b4e62bcc848', 'd9902244-2dcb-455d-8357-7d2aa9d0bed3', 'e7534612-42e5-499f-afe7-6e7d06cca59c', '4453d3f0-9938-4654-acde-29826a36c14a'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:54 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:45:54 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:55 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd" returned: 0 in 0.613s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:55 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.info Jul 05 17:45:55 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:55 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.670s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:45:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Deleted volume successfully. Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-b5592f56-ed06-425c-8854-aa09a0917512 tempest-ProjectReaderTests-2056459594 None] Lock "cinder-dadf9197-fb84-4f8e-b7f3-d7d6edda0066-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:45:55 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.info" returned: 0 in 0.761s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:55 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.info is being set with open permissions: ugo+rw Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:55 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.info Jul 05 17:45:55 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Flow 'volume_create_manager' (020e1585-d1e1-483e-8dc6-ed9848a8aaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c39044-6534-42aa-ba75-21ed7bdd40c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c39044-6534-42aa-ba75-21ed7bdd40c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494899068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9515e3-d610-436f-9dfd-bebf8a16f531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b8ca9b1fba4b00806b7dd41876bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:56Z,use_quota=True,user_id='bfe45ecb0af74d969979ca6ee3e92dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ac6b9f-c82a-4c2c-ae84-6768e815c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ac6b9f-c82a-4c2c-ae84-6768e815c30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680e7594-11a5-4ade-ac1a-439ecadc9455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680e7594-11a5-4ade-ac1a-439ecadc9455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9515e3-d610-436f-9dfd-bebf8a16f531', 'volume_name': 'volume-7d9515e3-d610-436f-9dfd-bebf8a16f531', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e18d42e-b738-4b53-b92f-914962d5bd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e18d42e-b738-4b53-b92f-914962d5bd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47c5d32-e887-4d0f-97f8-c2def1587766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:56 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Volume 7d9515e3-d610-436f-9dfd-bebf8a16f531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9515e3-d610-436f-9dfd-bebf8a16f531', 'volume_size': 1} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:56 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.info" returned: 0 in 0.752s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.453s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494899068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9515e3-d610-436f-9dfd-bebf8a16f531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b8ca9b1fba4b00806b7dd41876bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:45:56Z,use_quota=True,user_id='bfe45ecb0af74d969979ca6ee3e92dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Creating volume 7d9515e3-d610-436f-9dfd-bebf8a16f531 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:45:56 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:45:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:56 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 1073741824 Jul 05 17:45:56 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:56 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ab3636fd-4cb7-4008-9eca-fa9a0d54d0e5 tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:45:57 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 1073741824" returned: 0 in 0.825s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:57 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 Jul 05 17:45:57 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-2c99f47e-43bc-4ac0-bbc9-161a7844e6fd-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Lock "cinder-2c99f47e-43bc-4ac0-bbc9-161a7844e6fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-f5133216-e3cc-42ba-9ca3-989013ea928b" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-f5133216-e3cc-42ba-9ca3-989013ea928b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-2c99f47e-43bc-4ac0-bbc9-161a7844e6fd" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-2c99f47e-43bc-4ac0-bbc9-161a7844e6fd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot 2c99f47e-43bc-4ac0-bbc9-161a7844e6fd of volume f5133216-e3cc-42ba-9ca3-989013ea928b {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b1e35-5d67-4453-8a86-888c2d86e02c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:57 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd Jul 05 17:45:57 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:58 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531" returned: 0 in 0.680s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47c5d32-e887-4d0f-97f8-c2def1587766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9515e3-d610-436f-9dfd-bebf8a16f531', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb4beb1-2bc5-47c2-9876-a013d053b70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:45:58 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Volume volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 (7d9515e3-d610-436f-9dfd-bebf8a16f531): created successfully Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb4beb1-2bc5-47c2-9876-a013d053b70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Flow 'volume_create_manager' (020e1585-d1e1-483e-8dc6-ed9848a8aaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:45:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6bef7e95-13cf-4a59-bad3-3ea3f7e3bd4d tempest-ProjectReaderTests-2056459594 None] Created volume successfully. Jul 05 17:45:58 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd" returned: 0 in 0.762s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5133216-e3cc-42ba-9ca3-989013ea928b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c5d55b-7863-4b66-9813-58c4d26d2677]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:58 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b Jul 05 17:45:58 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Acquiring lock "cinder-7d9515e3-d610-436f-9dfd-bebf8a16f531-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Lock "cinder-7d9515e3-d610-436f-9dfd-bebf8a16f531-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:UPDATE=85,cinder:SELECT=75,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=65,cinder:UPDATE=97,cinder:INSERT=25,cinder:DELETE=11 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Acquiring lock "cinder-quobyte-7d9515e3-d610-436f-9dfd-bebf8a16f531" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Lock "cinder-quobyte-7d9515e3-d610-436f-9dfd-bebf8a16f531" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d2421e-bb7c-4a65-b9d7-4ef5b32721f8]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:59 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b" returned: 0 in 0.772s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:45:59 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:45:59 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 Jul 05 17:45:59 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:45:59 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd Jul 05 17:45:59 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:00 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531" returned: 0 in 0.817s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:00 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531 Jul 05 17:46:00 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:00 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd" returned: 0 in 0.767s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:00 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd Jul 05 17:46:00 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:00 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-7d9515e3-d610-436f-9dfd-bebf8a16f531" returned: 0 in 0.634s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Lock "cinder-quobyte-7d9515e3-d610-436f-9dfd-bebf8a16f531" released by "delete_volume" :: held 1.497s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:00 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b.2c99f47e-43bc-4ac0-bbc9-161a7844e6fd" returned: 0 in 0.660s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Created reservations ['cd2ec92a-d58a-4fbc-8cbd-43eaeef94493', '6e12de9d-e8c9-45a2-8f3a-ab47be21d9eb', '1a71c587-58db-423c-86b8-76132f87754e', '2883a4a4-ebc6-4e1a-852d-46b68b47a722'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-2c99f47e-43bc-4ac0-bbc9-161a7844e6fd" released by "_delete_snapshot" :: held 3.050s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-f5133216-e3cc-42ba-9ca3-989013ea928b" released by "delete_snapshot" :: held 3.077s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:00 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Created reservations ['62fcc72a-5822-44fd-9812-f7ec51ecae29', '336f005c-a4c9-423a-a215-4dd506374257', '45023487-ead1-4469-8641-db2c40eff9cf', 'c16cab11-f4df-4c21-9fe0-42c2b886efa4'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:00 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:00 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:00 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-47b497be-3f58-430d-891a-5784353b6932 tempest-ProjectMemberTests-514811562 None] Lock "cinder-2c99f47e-43bc-4ac0-bbc9-161a7844e6fd-delete_snapshot" released by "delete_snapshot" :: held 3.262s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:01 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.659s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:01 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Deleted volume successfully. Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-f3616a36-1667-4ce6-a627-9b6e4c8f25ce tempest-ProjectReaderTests-2056459594 None] Lock "cinder-7d9515e3-d610-436f-9dfd-bebf8a16f531-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Flow 'volume_create_manager' (7dc63405-e748-468d-bd0e-77eeb278d12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070761e8-65ec-4993-a250-1e9f079a8281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070761e8-65ec-4993-a250-1e9f079a8281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335403197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357a3009-fe40-441c-8fd3-4152bbe91c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b8ca9b1fba4b00806b7dd41876bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:02Z,use_quota=True,user_id='bfe45ecb0af74d969979ca6ee3e92dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dfc350-87c7-4c0d-bb13-86b3c7ba8a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dfc350-87c7-4c0d-bb13-86b3c7ba8a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46267890-dd6d-442a-8080-a844e345a51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46267890-dd6d-442a-8080-a844e345a51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357a3009-fe40-441c-8fd3-4152bbe91c5b', 'volume_name': 'volume-357a3009-fe40-441c-8fd3-4152bbe91c5b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9f4e2d-d937-46d1-a2c9-3b0393c3e46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9f4e2d-d937-46d1-a2c9-3b0393c3e46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fcb8a9-eb44-4266-b53d-5858ac381cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:01 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Volume 357a3009-fe40-441c-8fd3-4152bbe91c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357a3009-fe40-441c-8fd3-4152bbe91c5b', 'volume_size': 1} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335403197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357a3009-fe40-441c-8fd3-4152bbe91c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b8ca9b1fba4b00806b7dd41876bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:02Z,use_quota=True,user_id='bfe45ecb0af74d969979ca6ee3e92dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Creating volume 357a3009-fe40-441c-8fd3-4152bbe91c5b {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:46:01 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-f5133216-e3cc-42ba-9ca3-989013ea928b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:01 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b 1073741824 Jul 05 17:46:01 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:01 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Lock "cinder-f5133216-e3cc-42ba-9ca3-989013ea928b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-f5133216-e3cc-42ba-9ca3-989013ea928b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:02 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-f5133216-e3cc-42ba-9ca3-989013ea928b" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:02 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a07fe-a08c-40ea-b1cc-7986b62d8864]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:02 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b Jul 05 17:46:02 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:02 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b 1073741824" returned: 0 in 0.870s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:02 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b" returned: 0 in 0.785s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:02 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:02 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b Jul 05 17:46:02 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:02 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b Jul 05 17:46:02 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:03 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b" returned: 0 in 0.615s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fcb8a9-eb44-4266-b53d-5858ac381cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357a3009-fe40-441c-8fd3-4152bbe91c5b', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498db982-d719-4627-a5d8-ba53124040c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:03 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Volume volume-357a3009-fe40-441c-8fd3-4152bbe91c5b (357a3009-fe40-441c-8fd3-4152bbe91c5b): created successfully Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498db982-d719-4627-a5d8-ba53124040c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Flow 'volume_create_manager' (7dc63405-e748-468d-bd0e-77eeb278d12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:03 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-f5133216-e3cc-42ba-9ca3-989013ea928b" returned: 0 in 0.656s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:03 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-113c5351-163d-435e-bd24-4c5fa1cd095e tempest-ProjectReaderTests-2056459594 None] Created volume successfully. Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-f5133216-e3cc-42ba-9ca3-989013ea928b" released by "delete_volume" :: held 1.505s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Created reservations ['0e3af6fc-44a6-4c3b-a7d0-74d13f5cbe08', 'd75942d5-8bf6-47c0-bab7-58b68d243d89', '5e4ecb80-07d8-423b-9f5a-38ee3394f372', '33b7b48d-63a8-402b-9031-698209e9319e'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:03 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:03 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:03 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Acquiring lock "cinder-357a3009-fe40-441c-8fd3-4152bbe91c5b-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Lock "cinder-357a3009-fe40-441c-8fd3-4152bbe91c5b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Acquiring lock "cinder-quobyte-357a3009-fe40-441c-8fd3-4152bbe91c5b" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Lock "cinder-quobyte-357a3009-fe40-441c-8fd3-4152bbe91c5b" acquired by "delete_volume" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c626e-9112-47bd-bc9a-973538a18214]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:04 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b Jul 05 17:46:04 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:04 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.773s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:04 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-caffaddb-d1db-45c5-a917-7a0d90519df1 tempest-ProjectMemberTests-514811562 None] Lock "cinder-f5133216-e3cc-42ba-9ca3-989013ea928b-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (6c8abd1f-0924-490f-9388-157a6dea4cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f970b15-c6a1-4854-a9f0-dbc7d98a6878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f970b15-c6a1-4854-a9f0-dbc7d98a6878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92785517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004d4b22-ba6c-46e9-b161-a9d142e445a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:05Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f940b96-fe50-4b05-85e2-47c6802ac821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f940b96-fe50-4b05-85e2-47c6802ac821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bcc421-c84d-4103-a0bb-6bfdcd9c0070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bcc421-c84d-4103-a0bb-6bfdcd9c0070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004d4b22-ba6c-46e9-b161-a9d142e445a9', 'volume_name': 'volume-004d4b22-ba6c-46e9-b161-a9d142e445a9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e80deaa-f5af-475b-b15f-a240a60e50cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e80deaa-f5af-475b-b15f-a240a60e50cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f936ec6b-6e66-4df5-b344-63708ea4c63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:04 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Volume 004d4b22-ba6c-46e9-b161-a9d142e445a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004d4b22-ba6c-46e9-b161-a9d142e445a9', 'volume_size': 1} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92785517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004d4b22-ba6c-46e9-b161-a9d142e445a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:05Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Creating volume 004d4b22-ba6c-46e9-b161-a9d142e445a9 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:46:04 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:04 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 1073741824 Jul 05 17:46:04 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:04 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b" returned: 0 in 0.829s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:04 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:04 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b Jul 05 17:46:04 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:05 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 1073741824" returned: 0 in 0.815s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:05 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-357a3009-fe40-441c-8fd3-4152bbe91c5b" returned: 0 in 0.722s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Lock "cinder-quobyte-357a3009-fe40-441c-8fd3-4152bbe91c5b" released by "delete_volume" :: held 1.604s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:05 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 Jul 05 17:46:05 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Created reservations ['d57b1b52-9754-4fbc-8361-b373c041ff12', 'a65ba6e4-7d8f-4dc5-a1ea-3eaa3d41402a', '98d01ae1-e5a6-4858-9c4b-62b521c524b8', '25c58aaa-22b9-4c83-9be9-b5e530e5f1ad'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:05 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:05 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:05 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:06 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9" returned: 0 in 0.696s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f936ec6b-6e66-4df5-b344-63708ea4c63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004d4b22-ba6c-46e9-b161-a9d142e445a9', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da4dd8e-448d-4fd9-af84-22cf3a42c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:06 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Volume volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 (004d4b22-ba6c-46e9-b161-a9d142e445a9): created successfully Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da4dd8e-448d-4fd9-af84-22cf3a42c4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (6c8abd1f-0924-490f-9388-157a6dea4cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-96e4b422-6abe-4d28-8e91-abd32c247e5d tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:46:06 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.647s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:06 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Deleted volume successfully. Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d55100fa-993c-47ec-8c80-31e6f05ec43b tempest-ProjectReaderTests-2056459594 None] Lock "cinder-357a3009-fe40-441c-8fd3-4152bbe91c5b-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Flow 'volume_create_manager' (1c653a7c-34bf-486b-bc46-d24dafa2a6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54c65ed-600d-418b-8d11-33ed46bc0a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54c65ed-600d-418b-8d11-33ed46bc0a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2069882455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ed78f3-ba94-40f4-b1e6-66c2677030fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b8ca9b1fba4b00806b7dd41876bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:07Z,use_quota=True,user_id='bfe45ecb0af74d969979ca6ee3e92dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c3e13-bad1-4ff4-8117-eee562630238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c3e13-bad1-4ff4-8117-eee562630238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead2f52a-5e93-486a-a23a-a4744bea929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead2f52a-5e93-486a-a23a-a4744bea929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ed78f3-ba94-40f4-b1e6-66c2677030fa', 'volume_name': 'volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9781587d-b58b-4a1b-b378-cf811bd76dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9781587d-b58b-4a1b-b378-cf811bd76dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad51485d-76bd-4937-914f-398435ab373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:06 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Volume a8ed78f3-ba94-40f4-b1e6-66c2677030fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa', 'volume_size': 1} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2069882455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ed78f3-ba94-40f4-b1e6-66c2677030fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b8ca9b1fba4b00806b7dd41876bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:07Z,use_quota=True,user_id='bfe45ecb0af74d969979ca6ee3e92dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Creating volume a8ed78f3-ba94-40f4-b1e6-66c2677030fa {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:46:06 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:06 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa 1073741824 Jul 05 17:46:06 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:06 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:07 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa 1073741824" returned: 0 in 0.918s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:07 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:07 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa Jul 05 17:46:07 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:08 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa" returned: 0 in 0.627s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.430s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad51485d-76bd-4937-914f-398435ab373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d40b47-9c51-4498-a2f0-a3c5749c0c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Creating offline snapshot f3312d25-569b-4410-ad98-aeb58be0a4a5 of volume 004d4b22-ba6c-46e9-b161-a9d142e445a9 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:46:08 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Volume volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa (a8ed78f3-ba94-40f4-b1e6-66c2677030fa): created successfully Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d40b47-9c51-4498-a2f0-a3c5749c0c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Flow 'volume_create_manager' (1c653a7c-34bf-486b-bc46-d24dafa2a6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[919a1877-00ea-4345-9b08-7e47150c2809]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:08 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-0d1a6990-8f45-41e7-91fe-38f37f1cf712 tempest-ProjectReaderTests-2056459594 None] Created volume successfully. Jul 05 17:46:08 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 Jul 05 17:46:08 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Acquiring lock "cinder-a8ed78f3-ba94-40f4-b1e6-66c2677030fa-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Lock "cinder-a8ed78f3-ba94-40f4-b1e6-66c2677030fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Acquiring lock "cinder-quobyte-a8ed78f3-ba94-40f4-b1e6-66c2677030fa" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Lock "cinder-quobyte-a8ed78f3-ba94-40f4-b1e6-66c2677030fa" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[13879f28-3db6-409e-80b0-a54d8a280ee4]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:08 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:09 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa Jul 05 17:46:09 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:09 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9" returned: 0 in 0.825s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:09 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 1G Jul 05 17:46:09 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:09 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa" returned: 0 in 0.762s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:09 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:09 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa Jul 05 17:46:09 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:10 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 1G" returned: 0 in 0.827s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:10 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 Jul 05 17:46:10 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:10 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-a8ed78f3-ba94-40f4-b1e6-66c2677030fa" returned: 0 in 0.678s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Lock "cinder-quobyte-a8ed78f3-ba94-40f4-b1e6-66c2677030fa" released by "delete_volume" :: held 1.484s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Created reservations ['08601d36-6023-4385-8390-eed236bb91da', 'd62a95fe-6feb-4060-ac82-2f85222c07ff', 'a0464a26-7568-4486-931c-f5cd6e23a8dc', '7734d334-fb42-4b7e-ab1d-b2269561058b'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:10 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:10 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:10 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5" returned: 0 in 0.717s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:10 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 is being set with open permissions: ugo+rw Jul 05 17:46:10 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:10 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 Jul 05 17:46:10 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:11 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.712s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:11 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:11 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Deleted volume successfully. Jul 05 17:46:11 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-15b800d5-e81a-42e8-ae79-47ab592d599a tempest-ProjectReaderTests-2056459594 None] Lock "cinder-a8ed78f3-ba94-40f4-b1e6-66c2677030fa-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:11 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5" returned: 0 in 0.697s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:11 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:11 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.info Jul 05 17:46:11 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:12 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.info" returned: 0 in 0.723s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:12 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.info is being set with open permissions: ugo+rw Jul 05 17:46:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:12 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.info Jul 05 17:46:12 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:12 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.info" returned: 0 in 0.703s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:12 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.597s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:13 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-3147df8c-f14f-4441-bf61-d557fcaf7ff8 tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-f3312d25-569b-4410-ad98-aeb58be0a4a5-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Lock "cinder-f3312d25-569b-4410-ad98-aeb58be0a4a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-004d4b22-ba6c-46e9-b161-a9d142e445a9" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-004d4b22-ba6c-46e9-b161-a9d142e445a9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-f3312d25-569b-4410-ad98-aeb58be0a4a5" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-f3312d25-569b-4410-ad98-aeb58be0a4a5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot f3312d25-569b-4410-ad98-aeb58be0a4a5 of volume 004d4b22-ba6c-46e9-b161-a9d142e445a9 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a863c-5ed7-463c-98d3-386851e7357e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:13 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:13 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 Jul 05 17:46:13 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:14 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5" returned: 0 in 0.783s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:14 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004d4b22-ba6c-46e9-b161-a9d142e445a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:46:14 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da92e8-79f8-4dfb-b34a-18ecf9283498]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:14 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 Jul 05 17:46:14 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:14 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9" returned: 0 in 0.750s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:14 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:14 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 Jul 05 17:46:14 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:15 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5" returned: 0 in 0.716s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:15 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:15 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5 Jul 05 17:46:15 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:16 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9.f3312d25-569b-4410-ad98-aeb58be0a4a5" returned: 0 in 0.621s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-f3312d25-569b-4410-ad98-aeb58be0a4a5" released by "_delete_snapshot" :: held 2.957s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-004d4b22-ba6c-46e9-b161-a9d142e445a9" released by "delete_snapshot" :: held 2.980s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Created reservations ['290bc509-1ca6-4e88-8e80-3be14c8a44b6', '6fa3f3df-a876-4eff-8413-ae7b9cec6c01', 'b67fd6a8-5360-4032-8813-dc71ba10e155', '69b74836-f405-453a-9c52-b9780821f60a'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:16 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-29eaf4ae-029e-44a3-9426-4244a1452880 tempest-ProjectMemberTests-514811562 None] Lock "cinder-f3312d25-569b-4410-ad98-aeb58be0a4a5-delete_snapshot" released by "delete_snapshot" :: held 3.113s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-004d4b22-ba6c-46e9-b161-a9d142e445a9-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Lock "cinder-004d4b22-ba6c-46e9-b161-a9d142e445a9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-004d4b22-ba6c-46e9-b161-a9d142e445a9" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-004d4b22-ba6c-46e9-b161-a9d142e445a9" acquired by "delete_volume" :: waited 0.015s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcaeb3c-3e5b-43d8-9049-3532c807fc3f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:16 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:16 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 Jul 05 17:46:16 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:17 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9" returned: 0 in 0.715s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:17 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9 Jul 05 17:46:17 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:17 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-004d4b22-ba6c-46e9-b161-a9d142e445a9" returned: 0 in 0.628s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-004d4b22-ba6c-46e9-b161-a9d142e445a9" released by "delete_volume" :: held 1.397s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Created reservations ['47b079de-496c-4d21-ba27-5da76009cdd4', 'd9d7347a-2907-4d7f-a4ed-777b8a2304bc', '3fd4c5d9-4e31-47f9-8dbb-797ff084e677', '4fa1ec13-9762-47e1-952e-fe8a539a4efc'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:17 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:18 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:18 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:18 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:18 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.602s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:18 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:18 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:46:18 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c69eae4b-b30e-44ea-8ac9-c18d24a6e25f tempest-ProjectMemberTests-514811562 None] Lock "cinder-004d4b22-ba6c-46e9-b161-a9d142e445a9-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (71586e98-ad57-48dc-ab22-75badda7010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14fbad1d-07e6-4493-a65a-efa9e51cb6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14fbad1d-07e6-4493-a65a-efa9e51cb6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457864328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadcfd2a-6897-4351-b928-c235ac04bb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:19Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3a376b-8e3f-43ea-acb8-68baee2c5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3a376b-8e3f-43ea-acb8-68baee2c5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f52e4e-a7e0-4893-aa01-b0729db8408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f52e4e-a7e0-4893-aa01-b0729db8408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadcfd2a-6897-4351-b928-c235ac04bb07', 'volume_name': 'volume-eadcfd2a-6897-4351-b928-c235ac04bb07', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8103ac7-60ad-4866-9efd-51b3a8f8a448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8103ac7-60ad-4866-9efd-51b3a8f8a448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c1a7ca-c16a-42ee-89a7-d29eb2eda2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:19 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Volume eadcfd2a-6897-4351-b928-c235ac04bb07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadcfd2a-6897-4351-b928-c235ac04bb07', 'volume_size': 1} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457864328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadcfd2a-6897-4351-b928-c235ac04bb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:19Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Creating volume eadcfd2a-6897-4351-b928-c235ac04bb07 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:46:19 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:19 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 1073741824 Jul 05 17:46:19 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:19 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 1073741824" returned: 0 in 0.810s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:19 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:20 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 Jul 05 17:46:20 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:20 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07" returned: 0 in 0.608s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:20 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:46:20 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c1a7ca-c16a-42ee-89a7-d29eb2eda2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadcfd2a-6897-4351-b928-c235ac04bb07', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0c8404-ffe2-4181-9767-0704596ceb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:20 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Volume volume-eadcfd2a-6897-4351-b928-c235ac04bb07 (eadcfd2a-6897-4351-b928-c235ac04bb07): created successfully Jul 05 17:46:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0c8404-ffe2-4181-9767-0704596ceb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:20 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (71586e98-ad57-48dc-ab22-75badda7010c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:20 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a01e2935-4093-48bf-962b-1d930c090cc4 tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:46:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:21 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Creating offline snapshot fe5353bb-d277-4c8e-bc4e-60fce31a2744 of volume eadcfd2a-6897-4351-b928-c235ac04bb07 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:46:21 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad9bb38-03ef-4929-963a-8de395fb321c]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:21 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:21 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 Jul 05 17:46:21 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:22 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07" returned: 0 in 0.733s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:22 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 1G Jul 05 17:46:22 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:22 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 1G" returned: 0 in 0.772s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:22 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eadcfd2a-6897-4351-b928-c235ac04bb07 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:22 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eadcfd2a-6897-4351-b928-c235ac04bb07 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 Jul 05 17:46:22 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:23 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eadcfd2a-6897-4351-b928-c235ac04bb07 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744" returned: 0 in 0.658s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:23 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 is being set with open permissions: ugo+rw Jul 05 17:46:23 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:23 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 Jul 05 17:46:23 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:24 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744" returned: 0 in 0.625s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:24 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.info Jul 05 17:46:24 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:24 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.info" returned: 0 in 0.644s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:24 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.info is being set with open permissions: ugo+rw Jul 05 17:46:24 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:24 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.info Jul 05 17:46:24 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:25 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.info" returned: 0 in 0.670s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:25 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:25 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-83b70bc1-09f3-49e2-8efd-bef743219e24 tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-fe5353bb-d277-4c8e-bc4e-60fce31a2744-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Lock "cinder-fe5353bb-d277-4c8e-bc4e-60fce31a2744-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-eadcfd2a-6897-4351-b928-c235ac04bb07" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-eadcfd2a-6897-4351-b928-c235ac04bb07" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-fe5353bb-d277-4c8e-bc4e-60fce31a2744" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-fe5353bb-d277-4c8e-bc4e-60fce31a2744" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot fe5353bb-d277-4c8e-bc4e-60fce31a2744 of volume eadcfd2a-6897-4351-b928-c235ac04bb07 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c6925e-5393-4719-9fa1-03d0e4db439a]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:26 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:26 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 Jul 05 17:46:26 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:27 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744" returned: 0 in 0.720s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:27 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eadcfd2a-6897-4351-b928-c235ac04bb07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:46:27 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef328946-0253-4b6b-88ab-eea5933565cb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:27 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:27 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 Jul 05 17:46:27 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:28 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07" returned: 0 in 0.734s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:28 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 Jul 05 17:46:28 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:28 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744" returned: 0 in 0.698s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:28 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:28 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744 Jul 05 17:46:28 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:29 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07.fe5353bb-d277-4c8e-bc4e-60fce31a2744" returned: 0 in 0.632s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-fe5353bb-d277-4c8e-bc4e-60fce31a2744" released by "_delete_snapshot" :: held 2.875s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-eadcfd2a-6897-4351-b928-c235ac04bb07" released by "delete_snapshot" :: held 2.897s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Created reservations ['ea23458a-097f-423a-a1ff-6b16d887d64f', 'f366b851-8ebb-4283-89c2-3221fbdaf0f5', '2d9ea6c3-73e2-49bb-82ff-521894d05c9f', '1c7eb7b9-1a28-44c0-ac91-dcf0c9f3435d'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:29 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-d6a1aa36-d066-400b-9c65-f7027237cf66 tempest-ProjectMemberTests-514811562 None] Lock "cinder-fe5353bb-d277-4c8e-bc4e-60fce31a2744-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-eadcfd2a-6897-4351-b928-c235ac04bb07-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Lock "cinder-eadcfd2a-6897-4351-b928-c235ac04bb07-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-eadcfd2a-6897-4351-b928-c235ac04bb07" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-eadcfd2a-6897-4351-b928-c235ac04bb07" acquired by "delete_volume" :: waited 0.012s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7409b31-0e20-4f5b-b312-27ed5be96c0e]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:29 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:29 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 Jul 05 17:46:29 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:30 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07" returned: 0 in 0.720s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:30 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:30 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07 Jul 05 17:46:30 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:31 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-eadcfd2a-6897-4351-b928-c235ac04bb07" returned: 0 in 0.612s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-eadcfd2a-6897-4351-b928-c235ac04bb07" released by "delete_volume" :: held 1.386s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Created reservations ['579e299b-aa80-443a-be92-840f22adfa0e', 'a8ea4a2c-44fb-44da-9950-453c17cdd2ef', 'e6fb7a12-dde7-482e-88bc-cde0d87c2b15', 'a86d0668-46f0-46ba-8e4e-f90f91f4b770'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:31 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:31 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:31 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.623s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:31 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:46:31 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a73de574-c8de-4732-871b-565d36ffc2e3 tempest-ProjectMemberTests-514811562 None] Lock "cinder-eadcfd2a-6897-4351-b928-c235ac04bb07-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (29c94734-71d4-476a-ae79-48801724791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d3b74e-b9dc-4f0b-aac0-f80b60663472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d3b74e-b9dc-4f0b-aac0-f80b60663472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356830560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f324b1-0030-4c8c-92cd-44ac5522db59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:32Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954b45b2-e8af-4af3-8339-7873fa92be23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954b45b2-e8af-4af3-8339-7873fa92be23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1969ceaa-b72a-4888-a7e4-fd2719893f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1969ceaa-b72a-4888-a7e4-fd2719893f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f324b1-0030-4c8c-92cd-44ac5522db59', 'volume_name': 'volume-b8f324b1-0030-4c8c-92cd-44ac5522db59', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eea9c76-eefd-40c4-bf16-0fefd0834188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eea9c76-eefd-40c4-bf16-0fefd0834188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72fbf71-cce0-4837-bdc6-efc343022ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:32 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Volume b8f324b1-0030-4c8c-92cd-44ac5522db59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f324b1-0030-4c8c-92cd-44ac5522db59', 'volume_size': 1} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356830560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f324b1-0030-4c8c-92cd-44ac5522db59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7279742f24694a9cc81b9f5de3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:32Z,use_quota=True,user_id='4425fd4cd357410b84799880f09958fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Creating volume b8f324b1-0030-4c8c-92cd-44ac5522db59 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:46:32 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:46:32 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:32 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 1073741824 Jul 05 17:46:32 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:33 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 1073741824" returned: 0 in 0.795s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:33 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 Jul 05 17:46:33 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:33 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59" returned: 0 in 0.628s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72fbf71-cce0-4837-bdc6-efc343022ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f324b1-0030-4c8c-92cd-44ac5522db59', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f09aef-3e16-482d-9eab-02fab8d5f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:33 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Volume volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 (b8f324b1-0030-4c8c-92cd-44ac5522db59): created successfully Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f09aef-3e16-482d-9eab-02fab8d5f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:33 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Flow 'volume_create_manager' (29c94734-71d4-476a-ae79-48801724791d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:33 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6ea1ca49-39c0-4e40-b5f9-aa9aa5b0b98b tempest-ProjectMemberTests-514811562 None] Created volume successfully. Jul 05 17:46:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:34 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Creating offline snapshot fd44a301-033e-448b-bf0a-a98b0749d569 of volume b8f324b1-0030-4c8c-92cd-44ac5522db59 {{(pid=86459) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 17:46:34 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e89a4f0-eb7f-4269-94ca-3ae2325bf5a3]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:34 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:34 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 Jul 05 17:46:34 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:35 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59" returned: 0 in 0.711s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:35 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 1G {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:35 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 1G Jul 05 17:46:35 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:36 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 1G" returned: 0 in 0.765s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:36 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 Jul 05 17:46:36 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:36 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 -F qcow2 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569" returned: 0 in 0.660s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:36 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 is being set with open permissions: ugo+rw Jul 05 17:46:36 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:36 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 Jul 05 17:46:36 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:37 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569" returned: 0 in 0.631s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:37 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:37 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.info Jul 05 17:46:37 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:38 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.info" returned: 0 in 0.645s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:38 devstack cinder-volume[86459]: WARNING cinder.volume.drivers.remotefs [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.info is being set with open permissions: ugo+rw Jul 05 17:46:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.info {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:38 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.info Jul 05 17:46:38 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:38 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.info" returned: 0 in 0.628s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:38 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.125s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:38 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-206a700c-c571-4194-8032-17adb3fed91c tempest-ProjectMemberTests-514811562 None] Create snapshot completed successfully Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-fd44a301-033e-448b-bf0a-a98b0749d569-delete_snapshot" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Lock "cinder-fd44a301-033e-448b-bf0a-a98b0749d569-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-b8f324b1-0030-4c8c-92cd-44ac5522db59" by "delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-b8f324b1-0030-4c8c-92cd-44ac5522db59" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-fd44a301-033e-448b-bf0a-a98b0749d569" by "_delete_snapshot" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-fd44a301-033e-448b-bf0a-a98b0749d569" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Deleting offline snapshot fd44a301-033e-448b-bf0a-a98b0749d569 of volume b8f324b1-0030-4c8c-92cd-44ac5522db59 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] snapshot_file for this snap is: volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 {{(pid=86459) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c5570c-aee2-4819-bfce-ff99361fe30f]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:39 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:40 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 Jul 05 17:46:40 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:40 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569" returned: 0 in 0.718s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:40 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8f324b1-0030-4c8c-92cd-44ac5522db59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86459) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 17:46:40 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d4be20-2e7f-48f8-a23c-212ad57b8485]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:40 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:40 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 Jul 05 17:46:40 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:41 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59" returned: 0 in 0.712s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:41 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:41 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 Jul 05 17:46:41 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:42 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569" returned: 0 in 0.693s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:42 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569 Jul 05 17:46:42 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:42 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:42 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59.fd44a301-033e-448b-bf0a-a98b0749d569" returned: 0 in 0.627s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-fd44a301-033e-448b-bf0a-a98b0749d569" released by "_delete_snapshot" :: held 2.833s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-b8f324b1-0030-4c8c-92cd-44ac5522db59" released by "delete_snapshot" :: held 2.853s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:42 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Created reservations ['5dcdd2a2-7cfe-436e-9900-a000fd176b2b', 'bfb106a7-fa70-4d10-92cd-baed91970fd1', 'd80c2fa1-7352-4031-bc66-58a3e742f1e6', '0a67bb7e-7333-47c3-9ce9-c92f6e448a03'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:42 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Delete snapshot completed successfully. Jul 05 17:46:42 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-5e3bf553-6dd9-48ff-8b23-0421408a5159 tempest-ProjectMemberTests-514811562 None] Lock "cinder-fd44a301-033e-448b-bf0a-a98b0749d569-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-b8f324b1-0030-4c8c-92cd-44ac5522db59-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Lock "cinder-b8f324b1-0030-4c8c-92cd-44ac5522db59-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Acquiring lock "cinder-quobyte-b8f324b1-0030-4c8c-92cd-44ac5522db59" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:43 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-b8f324b1-0030-4c8c-92cd-44ac5522db59" acquired by "delete_volume" :: waited 0.014s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:43 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a90ab1b-9ae6-4c02-8b20-96ae6a8af561]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:43 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 Jul 05 17:46:43 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:43 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59" returned: 0 in 0.746s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:43 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:43 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59 Jul 05 17:46:43 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:44 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-b8f324b1-0030-4c8c-92cd-44ac5522db59" returned: 0 in 0.610s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Lock "cinder-quobyte-b8f324b1-0030-4c8c-92cd-44ac5522db59" released by "delete_volume" :: held 1.410s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Created reservations ['736fe24a-5bfb-4f7a-aa8c-99fb8c1256bf', '74301c7c-49f6-4c94-9386-39d6deac9165', '40499291-2388-401b-a9e9-32a56897d7f2', '9dd5af9c-9cff-40bc-a376-fd74161b0fa1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:44 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:44 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:44 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:45 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:45 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.623s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:45 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:45 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Deleted volume successfully. Jul 05 17:46:45 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-6403df3b-fbc1-452d-b24c-e46b1f28c747 tempest-ProjectMemberTests-514811562 None] Lock "cinder-b8f324b1-0030-4c8c-92cd-44ac5522db59-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:48 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Flow 'volume_create_manager' (91543463-4016-4002-b796-e084758809bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bf3a2a-7c61-4018-9848-8e037ae4e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bf3a2a-7c61-4018-9848-8e037ae4e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312709170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c40c6a-b131-41e0-9b76-de1d4cf6d639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1935b17c351b4705a63354dee0637e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:49Z,use_quota=True,user_id='285c88bbbce24662b83b04a5ce4f0f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece03948-edab-4ebb-bd2f-5b2a9806a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece03948-edab-4ebb-bd2f-5b2a9806a4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6304b9-92d9-4226-acfc-f3db58c92744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6304b9-92d9-4226-acfc-f3db58c92744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c40c6a-b131-41e0-9b76-de1d4cf6d639', 'volume_name': 'volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d5108c-1ccb-4cab-8e4d-ce32813c2ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d5108c-1ccb-4cab-8e4d-ce32813c2ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69ac81d-a9d4-448d-a85c-4cd3c046cac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:49 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Volume 24c40c6a-b131-41e0-9b76-de1d4cf6d639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639', 'volume_size': 1} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312709170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c40c6a-b131-41e0-9b76-de1d4cf6d639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1935b17c351b4705a63354dee0637e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:49Z,use_quota=True,user_id='285c88bbbce24662b83b04a5ce4f0f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Creating volume 24c40c6a-b131-41e0-9b76-de1d4cf6d639 {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:46:49 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:49 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 1073741824 Jul 05 17:46:49 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:49 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 1073741824" returned: 0 in 0.782s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:49 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:49 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 Jul 05 17:46:49 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:50 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639" returned: 0 in 0.631s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69ac81d-a9d4-448d-a85c-4cd3c046cac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec81630-9567-41b3-82cd-b909cae8237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:50 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Volume volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 (24c40c6a-b131-41e0-9b76-de1d4cf6d639): created successfully Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec81630-9567-41b3-82cd-b909cae8237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Flow 'volume_create_manager' (91543463-4016-4002-b796-e084758809bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:50 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-07c720d1-a996-400e-8131-da0551474b37 tempest-ProjectReaderTests-1349862025 None] Created volume successfully. Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:50 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:50 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:50 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "cinder-24c40c6a-b131-41e0-9b76-de1d4cf6d639-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Lock "cinder-24c40c6a-b131-41e0-9b76-de1d4cf6d639-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "cinder-quobyte-24c40c6a-b131-41e0-9b76-de1d4cf6d639" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Lock "cinder-quobyte-24c40c6a-b131-41e0-9b76-de1d4cf6d639" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b52c686-0bdc-4d08-80be-9adbb140eac3]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:51 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 Jul 05 17:46:51 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:51 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.732s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG oslo_service.periodic_task [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] Running periodic task VolumeManager._thread_info {{(pid=86459) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread count: 28 {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 17:46:51 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-211a369d-8cb3-4d52-ab63-805064c2a31b None None] thread info: [<_MainThread(MainThread, started 131394537562240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86459) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 17:46:52 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639" returned: 0 in 0.743s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:52 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639 Jul 05 17:46:52 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:52 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-24c40c6a-b131-41e0-9b76-de1d4cf6d639" returned: 0 in 0.633s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Lock "cinder-quobyte-24c40c6a-b131-41e0-9b76-de1d4cf6d639" released by "delete_volume" :: held 1.422s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Created reservations ['bb504626-062e-470d-86fd-ef269e782957', '1882f017-434d-43f0-83e1-79d7c05d1e46', '062f655f-23c5-46b2-9ca7-58809eb3b022', '64002f4a-3176-485e-9fb0-4f9ca032bba1'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:52 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:52 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:52 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:53 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:53 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.642s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:53 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:53 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Deleted volume successfully. Jul 05 17:46:53 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-c5c1f9fc-4441-4f3b-95c4-a882ff3e8729 tempest-ProjectReaderTests-1349862025 None] Lock "cinder-24c40c6a-b131-41e0-9b76-de1d4cf6d639-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:53 devstack cinder-volume[86459]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86459) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Flow 'volume_create_manager' (d560ddd1-2e65-495a-ae44-8120157c707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c8dbc0-aa56-417f-9bd3-834d295ff4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c8dbc0-aa56-417f-9bd3-834d295ff4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773862422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28187b6e-0835-41b8-be50-f8389552197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1935b17c351b4705a63354dee0637e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:54Z,use_quota=True,user_id='285c88bbbce24662b83b04a5ce4f0f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d122e4e-f15e-4d27-b7f5-c0a3e9150ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d122e4e-f15e-4d27-b7f5-c0a3e9150ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3b3e1d-2930-449d-b864-22a73125614f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3b3e1d-2930-449d-b864-22a73125614f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28187b6e-0835-41b8-be50-f8389552197f', 'volume_name': 'volume-28187b6e-0835-41b8-be50-f8389552197f', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db44a89-68dc-4c08-a3e5-f5c0968843b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db44a89-68dc-4c08-a3e5-f5c0968843b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47a6418-0e4c-4aec-902e-3e75a207f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:54 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Volume 28187b6e-0835-41b8-be50-f8389552197f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28187b6e-0835-41b8-be50-f8389552197f', 'volume_size': 1} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T15:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773862422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28187b6e-0835-41b8-be50-f8389552197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1935b17c351b4705a63354dee0637e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T15:46:54Z,use_quota=True,user_id='285c88bbbce24662b83b04a5ce4f0f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8),volume_type_id=84af6d03-cb1b-4eb4-9f95-0f52ef51c8a8)}" {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.remotefs [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Creating volume 28187b6e-0835-41b8-be50-f8389552197f {{(pid=86459) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Selected osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e as target Quobyte volume. {{(pid=86459) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 17:46:54 devstack cinder-volume[86459]: INFO cinder.volume.drivers.remotefs [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] casted to osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f 1073741824 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:54 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f 1073741824 Jul 05 17:46:54 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:54 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:54 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f 1073741824" returned: 0 in 0.907s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:55 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f Jul 05 17:46:55 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:55 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f" returned: 0 in 0.719s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:55 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'} {{(pid=86459) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 17:46:55 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47a6418-0e4c-4aec-902e-3e75a207f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28187b6e-0835-41b8-be50-f8389552197f', 'volume_size': 1}' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c36591-9a4b-4077-8a77-ca586067db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 17:46:55 devstack cinder-volume[86459]: INFO cinder.volume.flows.manager.create_volume [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Volume volume-28187b6e-0835-41b8-be50-f8389552197f (28187b6e-0835-41b8-be50-f8389552197f): created successfully Jul 05 17:46:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c36591-9a4b-4077-8a77-ca586067db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86459) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 17:46:55 devstack cinder-volume[86459]: DEBUG cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Flow 'volume_create_manager' (d560ddd1-2e65-495a-ae44-8120157c707f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86459) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 17:46:55 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-ed6ba7d9-90b5-4a24-8e93-929a53fe8cf1 tempest-ProjectReaderTests-1349862025 None] Created volume successfully. Jul 05 17:46:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "cinder-28187b6e-0835-41b8-be50-f8389552197f-delete_volume" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Lock "cinder-28187b6e-0835-41b8-be50-f8389552197f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "cinder-quobyte-28187b6e-0835-41b8-be50-f8389552197f" by "delete_volume" {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 17:46:56 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Lock "cinder-quobyte-28187b6e-0835-41b8-be50-f8389552197f" acquired by "delete_volume" :: waited 0.016s {{(pid=86459) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 17:46:56 devstack cinder-volume[86459]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef52a24-f695-4903-8df2-d2b1e4ec5ddb]: (4, 'qcow2') {{(pid=87482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 17:46:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:56 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f Jul 05 17:46:56 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:56 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f" returned: 0 in 0.753s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:56 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:56 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f Jul 05 17:46:56 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:57 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4/volume-28187b6e-0835-41b8-be50-f8389552197f" returned: 0 in 0.681s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Lock "cinder-quobyte-28187b6e-0835-41b8-be50-f8389552197f" released by "delete_volume" :: held 1.474s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG cinder.quota [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Created reservations ['2acfac5e-e298-41ae-a100-9dee1a517b72', 'f05135c0-746e-46e7-8dc8-381eda69330a', '11c11790-b69b-41e6-a128-b314a55be3f5', '204c2132-6db8-41f0-b796-d2828bf2fcd0'] {{(pid=86459) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e': None} {{(pid=86459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG cinder.volume.drivers.quobyte [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27564f73-fbfd-41a0-90a0-b8d90d49bf2e'] {{(pid=86459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.lockutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 17:46:57 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 17:46:57 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4 Jul 05 17:46:57 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 17:46:58 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 05 17:46:58 devstack cinder-volume[86459]: DEBUG oslo_concurrency.processutils [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9b29f729aef4452f32135c3f251cbdb4" returned: 0 in 0.626s {{(pid=86459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 17:46:58 devstack cinder-volume[86459]: DEBUG cinder.manager [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Notifying Schedulers of capabilities ... {{(pid=86459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 17:46:58 devstack cinder-volume[86459]: INFO cinder.volume.manager [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Deleted volume successfully. Jul 05 17:46:58 devstack cinder-volume[86459]: DEBUG cinder.coordination [None req-a267afd2-09c5-43f8-a655-ddc07ada2da4 tempest-ProjectReaderTests-1349862025 None] Lock "cinder-28187b6e-0835-41b8-be50-f8389552197f-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86459) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 17:47:07 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=75,cinder:INSERT=27,cinder:UPDATE=116,cinder:DELETE=7 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 17:47:08 devstack cinder-volume[86459]: DEBUG dbcounter [-] [86459] Writing DB stats cinder:SELECT=94,cinder:INSERT=35,cinder:UPDATE=123,cinder:DELETE=12 {{(pid=86459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}